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FREQUENT TESTING AS A MOTIVATING FACT 
IN LARGE LECTURE CLASSES 
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MILDRED L. FITCH, A. J. DRUCKER, and J. A. NORTON, JR. 
` Purdue University 


_ Any instructional procedure is useful which stimulates the 
Interest of the student and produces desirable activity leading 
to educational accomplishment and growth. Although the lec- 
ture method, as used in colleges and universities, has not been 
shown to be an ineffective method of instruction, even with large 
groups, !? many instructors, especially in the social sciences, like 
to supplement lectures with recitation or student-instructor dis- 
cussions or avoid lectures as much as possible. Large enroll- 
ments in basic college courses pretty much preclude discus- 
Sion or recitation methods whose aim is extensive student 


Participation. 
This study deals with the investigation of two interrelated 
tudent achievement 


Instructional devices employed to improve S 
in a lecture course in Government, where classes number from one 
hundred to two hundred. To the regular three one-hour lecture 
Sessions are added several hour-long discussion sessions, attend-. 
ance at any of which is optional on the part of the student. The 
other device is a program of weekly quizzes over course material, 
where results of such testing are not used in determining the 
Course grade. Frequent measurement is expected to result D 
Steadier application of the individual to the task at hanc, 
this instructional function of measurement being best serve 
When divorced from the regular process of achievement 
evaluation. MS 
There is some objective evidence that frequent testing an P 
Classroom results in better achievement. ** Knowledge = 
Tesults, a probable outcome of frequent testing, has also bee 


Shown to aid learning." 
1 
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EXPERIMENTAL PROCEDURE 


The current study was undertaken to explore further the 
effects of frequent testing upon motivation of college students 
№ -to achieve. and the students’ outside endeavor with respect to à 
particular courSe sontent. The achievement of two large classes 
of students in Government 10, a required course in the School of 
Science at Purdue University, were used to determine the benefits 
to learning gained when (a) short quizzes for the purpose of guid- 
ing the student's own achievement were given in one class over 
the weekly assignments, and (b) voluntary discussion groups were 
provided for both classes each week in addition to the three reg- 
ular class periods. The control group was designated as the class 
of ninety-seven students to whom only the regular monthly 
quiz was given, and the experimental group consisted of the other 
class of one hundred ninety-eight students to whom the weekly 
quiz was administered in addition to the regular monthly quiz. 
Both classes met at 9 o'clock on alternate days three times a week. 
The senior author was the lecturer for the course. Assignment 
of individuals to these classes was not believed to be related to 
factors of sex, age, ability or curriculum. No knowledge of the 
study was given to the students. 

The lecture method was used over identical material for both 
classes and the same reading assignments were made. The last 
half hour of the third class meeting each week was open for dis- 
cussion or questions from the floor, primarily over the reading 
assignments. This was followed by a ten-minute quiz in the 
experimental section only, and this quiz was confined to the 
reading assignments in the texts and not to the supplementary 
material covered in the lectures. Thus both classes had identical 
lectures and reading assignments and opportunity to raise que 
tions for discussion in one regular class period. 

Four one-hour tests were administered to both groups during 
the semester over the work covered each month. 4A fifth test, 
which reviewed topics covered during the semester, was also 
given at the end of the course. The first, fourth and fifth tests 
were objective—true-false, multiple choice, matching or short 
answer—and the second and third were essay-type tests. 

The three objective tests were identical for both classes. 
two essay tests were composed of ‘thought’ questions given to 


The 


D £1 
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students of both classes before the day of testing. Every effort 
was made to make the essay tests comparable. All tests were 
administered to the experimental section before the control sec- 
tion; hence it is believed that advance knowledge of the objective 
test questions obtained before the test would benefit only tho; 
control section. T. = 

Six voluntary discussion sections, set up at different hours 
during the middle of the week at times which would best accom- 
modate the students, were handled by two graduate students. * 
These sections were arranged as an outlet for discussion for stu- 
dents who felt they would learn more if they had the opportunity 
for more personal contact with an instructor than large lecture 
sections could provide. It was evident, however, that attend- 
ance at the discussion sections was increased when topics for 
monthly test review could be discussed, although this was not 
the original intention. A poll of the sections showed that the 
use of the discussion groups on a voluntary basis was favored by a 
substantial majority of both groups. Weekly quizzes were also 
favored by both groups, the control people having become famil- 
iar with weekly quizzes through their use in Government 9 the 
previous semester, Asa matter of fact, when the weekly quizzes 
Were not resumed at the start of the semester for the control 
Section, some complaints were registered by students who had 
favored that technique in Government 9 as a device to encourage 
them to read their weekly assignments. 


ANALYSIS AND nrsuLTST 


The Variables.— The criterion variable for evaluating the exper- 
imental results is based on the grades assigned in the five one-hour 
tests given in both experimental and control sections, and graded 
Jointly for both sections. The grades assigned on each test were 
based on the Purdue University number grading sysiem, WI 
values one through six, but greater differentiation Was available 
through the use of plusses and minusses appended to the pe 
grade. These grades were assigned on each test on the мет 0 
the frequency distribution of scores on that test, and were deter- 


e Katz also assisted in the compila- 


. * Mrs. Ingebord Vance and Mrs. Leon 
tion of the data and preliminary statistical work. 


T By Mr. Norton. 
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mined by a standard grading curve giving the approximate pro- 


„portion of students who should receive each grade. Thus the 


grade distribution on each test represents not only a standardized, 
but also, approximately, a normalized variable, since the stand- 
ard grading curve was based (roughly) on the normal curve. The 
criterion variable Y was based on the sum of the grades on these 
five tests. A sum of approximately normal variables, Y itself 
was found to be approximately normally distributed. 

Because of the conditions of scheduling, registration, and other 
administrative processes which make it difficult to carry on а 
controlled educational experiment in a large university situation, 
the experimental and control sections cannot be represented as 
random samples from any definable common population. For 
these reasons it was desirable to exercise statistical control 
over the nature of the two groups to be used for evaluating the 
experimental variable. The most easily available, as well as the 
most relevant variable for this purpose was the grade received 
in the preceding semester of the same course, Government 9. 
This grade is designated as X, the independent or control vari- 
able. It was available only in the gross number grades of the 
Purdue University grading system, with six possible values, and 
only five occurring in the sample used for analysis. However, 
this variable is believed to be entirely satisfactory for the pur- 
poses of statistical control for which it is used here. An addi- 
tional valuable property of the criterion variable Y is that the 
regression of Y on X was almost perfectly linear. 

Factors for the Analysis.—Table 1 gives in percentage form the 
distribution of frequency of voluntary attendance at the discus- 
sion groups for all members of both sections whose records were 
sufficiently complete to make them eligible for inclusion in the 
analysis. Table 1 also gives the break-down into four categories 
which was subsequently used for the discussion attendance varl- 
able, and the percentage distribution for this break-down. The 
upper two boundary lines for this break-down were chosen 
to conform, approximately, with natural valleys in the two 
distributions. 

The distributions in Table 1 invite interesting specula 
hypotheses. In the first place, an almost identical percentage 9 
cases in each section attended no discussion groups. One 38 
tempted to speculate that these represent the students who ате 


tive 
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TABLE 1.—ArrenpaNce AT DISCUSSION Groups: ALL ELIGIBLE 


Cases IN Boru SECTIONS ч 
" Control Section Experimental Section 
Discus- 
mined Per cent Per cent 
eas d for group- for group- 
ing chosen ing chosen 
14 0 5.9 
13 Les 7.5 
12 l. 4.8 
11 i 5.4 |76 = 40.9% 
10 5. 6.5 
9 Biz 4.8 
8 4. 4.3 
T j 2.2 
6 1.6 
5 1.1 (21 = 11.3% 
4 4.8 
3 3.8 
2 2.2 
1 9.1 |21 = 11.396 
0 36.6 36.6% 


simply not interested in any activity in connection ym А 
course which is not required of them, and the equal iar cd 
Suggest that this attitude is in no «€ p» om 
ti i type experimented wi er 

at ыы: f the students who would 


quizzing). Of the sixty-four per cent of tl t 1 
and did attend one or more voluntary discussion рь m 
ever, there was a marked difference in behavior between the two 


Sections. Of the students in the control section who — 
attend any discussion groups at all, only about one-q 
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attended more than six. In all probability this is directly 
related to the fact that these students were given only the five 
one-hour tests during the course of the semester, as it has been 
noted above that the size of the attendance at the discussion 
groups seemed to be related to the dates of these tests. In con- 
trast, of the students in the experimental, frequently-quizzed 
section who would attend any discussion groups at all, nearly 
two-thirds attended seven or more. It seems clear that for those 
students who will participate at all in a voluntary activity of this 
sort, the motivational device experimented with here bears а 
significant and important relationship to frequency of attend- 
ance at the discussion groups. 

Several questions now arise. Is attendance at discussion 
groups related to achievement in the course, as measured by Y? 
If it is, and if the experimental section shows superior achieve- 
ment over the control section, to what extent can this superiority 
be explained by the more frequent attendance at discussion 
groups motivated in the experimental section? Even more 
important, what are the answers to these same questions if the 
effects of the variable X (Government 9 grades) which, among 
other things, presumably measures initial interest and ability 
in this course, are partialled out? The analysis was designed to 
answer these questions. 

Design of the Analysis.—Since it was desired to make the com 
parison between the achievement of the experimental section 
and that of the control section taking into account the factor of 
discussion attendance, it was necessary to classify the data 
according to a double-classification scheme. ‘Table 2 shows thi 
scheme as а 4 X 2 table of eight cells: four classes on the vertical 
axis representing the four groupings of discussion attendance 
frequency given in Table 1 and two classes on the horizontal аХ!5 
representing membership in the control or in the experimental 
section. e 

"the methods employed were those of analysis of covariance: 
Our applieation of these methods dillers, however, from those 
more commonly occurring. We have pointed out, in the И 157 
cussion of Table 1, the marked dissimilarity in the distributions 
into discussion attendance classifications between the control ar 
experimental sections. This is a situation that is frequent 
called the case of disproportionate frequencies (the ‘поп-0г thos 
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onal case’). The disproportionate frequencies situation requires 
special procedures which we shall not go into in detail. (See 
Snedecor? or Tsao.!!) We shall, however, discuss some of the 


basic considerations involved. * 
In the case of disproportionate frequencies one must choose 


between two basic assumptions on which to proceed:"! 
Assumption A: We are interested in making inferences for a 
population which has equal frequencies in the cells formed 
by our classificatory factors; the unequal and dispro- 
portionate cell frequencies in our sample are merely a 
result of chance sampling effects, and are not character- 
istic of the population in which we are interested. 
Assumption B: The disproportionate cell frequencies in our 
sample are the result of characteristics inherent in the 
classifieatory factors to be studied, and we are interested 
in inferring to a population whose cell frequencies are 
stratified approximately as are those in our sample. 
From our discussion of the dissimilar distributions in Table 1 
it is clear that Assumption A was not the one for us. We chose 
to assume instead that the dissimilarity in the two distributions 


* No attempt will be made here to go into detail on the theory and pro- 
on the intent and 


cedures of these methods. A word is in order, however, € 
vestigation of this sort. We 


function of the analysis of covariance in an in 

have mentioned that we desired to exercise statistical control over the 
variable X—final grade in Government 9. In most research work in edu- 
cation and other social sciences, such control is achieved by matching cases 
in the two groups to be compared on the variable to be controlled. т this 
is done ex post facto, as it frequently must be,? there is usually a qs 
resulting loss in cases which must be discarded because no match can be 
found for them in the other group or groups. The very great ene scel 
the methods of analysis of covariance inan investigation of this m at У 

it achieves the effect of such individual matching on the ea le eb 
controlled, without the necessity of carrying out the pee erts Len 
cedures, and therefore without the loss of cases that m a тра 

procedures. Furthermore, the application of these = ШШ ы ER 
extended to more highly complex designs, vs cig eh nM 
On several factors to be studied simultancously (as in i. he bo ended 
lave a design involving double classification on two factors t 


В i ; rohibi- 
simultaneously), whereas individual matching peti tso extend to the 
tively unwieldy on such complex designs. | нр dividual match- 
Statistical control of more than one variable, where agam pesi бын. 
ing procedures become difficult, if not impossible. Кога 


5 " 
tion about covariance see references 6, 5, 8, and 9 
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in Table 1 was a direct result of the motivational device which 
constitutes the experimental teaching method, and this is cer- 
tainly just as true for the population to which we are interested 
in inferring as it is for the sample at hand. We could not, how- 
ever, make Assumption B and proceed on the basis of the dis- 
tributions as given in Table 1, either. To do so would have 
meant that we were assuming that it is always characteristic of 
the experimental, frequently-quizzed groups to run, on the aver- 
age, approximately twice as large as less frequently-quizzed 
groups like the control group! Clearly we did not want to 
include scheduling irregularities as part of our experimental 
hypothesis. 

This problem was resolved as follows: using a table of random 
sampling numbers “ or (?, a random sample of ninety-one 
cases was selected from the one hundred eighty-six eligible cases 
in the experimental section. Using these ninety-one cases, and 
the ninety-one eligible cases from the control section, we could 
then set up our table of double classification for analysis. ‘This is 
given in Table 2, which shows equal total membership in the 
control and the experimental sections, thus obviating the diffi- 
culty referred to in the last paragraph, but nevertheless retains, 
within random sampling fluctuations, the dissimilar distributions 
of discussion attendance in the two sections, On such a table 
we were able to proceed under Assumption B. 

A study of Table 2 will be helpful in understanding some of the 
results of the later analysis. We observe, first, that the experi- 
mental section with a mean of 62.7 does seer to exceed sub- 
stantially the control section with a mean of 55.5 on the criterion 
variable Y. However, note that the experimental section also 
has a greater mean on the initial variable X than does the contro 
section. This latter difference might substantially affect the 
comparison between the two groups on Y. Next note the pat- 
tern of the marginal X-means for the discussion attendance 
groupings. For those students who attended any discussion 
groups at all in this course, the average final grade in the prece 
ing semester of the same course decreases regularly with decreas- 
ing attendance at such discussion groups. This would seem ie 
lend support to the hypothesis that the X variable serves 28 ? 
measure of interest in and/or conscientious endeavor with respe? 
to this course, which, for these students, led them to attend one 
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or ; ; 

€ vs of the discussion groups. The students who attended 
X iscussion groups, however, reverse this trend, and have an 
X-mean not far from the grand X-mean for all cases. This seems 


Ta DES 5 
ABLE 2, *— DOUBLE CLASSIFICATION TABLE: ALL ELIGIBLE CASES 
FROM CONTROL Section; A RANDOM SAMPLE OF Еол N 
FROM EXPERIMENTAL SECTION 


Control Experimental 
Section Section 
Infrequent Frequent 
Quizzing Quizzing Total 
7-14 N 16 (17.6%) 34 (87.4%) 50 
М, 4.31 4.21 4.24 
M, 63.6 65.6 65.0 
3-6 N 19 (20.9%) 14 (15.4%) 33 
Discus- M, 4.05 4.36 4.18 
sion M, 59.1 62.6 60.6 
Attend- 1-2 ү 23 (25.3%) 10 (11.0%) 33 
айшә М, 3.70 3.9 3.76 
M, 50.6 60.5 58.6 
None N 33 (36.3%) 33 (36.3%) 66 
M. 3.88 4.15 4.02 
M, 53.0 60.4 56.7 
Total N 91 (100%) 91 (10095) 182 
M, 3.95 4.18 4.06 
М, 55.5 62.7 59.1 


* In the case of this and all subsequent tables, calculations were carried 


to several more significant digits than those given. 


to support the speculation, made above, that these ree 
Шегед in some characteristic qualitative manner from the a А 
Whose observed effect is that they simply did not (perhaps m 
Dot) attend voluntary diseussion groups, but that this ма n 
Necessarily imply lower interest and/or ability in this ше E 
that displayed by students who did attend discussion zi ble, 

ecause the two sections were not comparable on the X E aed 
and because the X variable seems t lated to as 


o: be Кє, f particular 
attendance for all those above the * None! group; itis of p 


A 


~i 
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importance that we propose to ‘partial out’ by statistical control 
the ‘predetermination’ effects of X in making our comparisons. 
Note, finally, that the percentage distribution into discussion 
attendance groupings in the experimental section in Table 2 is 
similar to, but not exactly the same as that in Table 1. This, of 
course, is due to the sampling process in which we have engaged 
in order to obtain the ninety-one cases which represent the 
experimental method in Table 2. The largest discrepancy 
between the percentages in Table 1 and those in Table 2—that 
in the 3-6 discussion attendance group—is, however, no larger 
than might be expected by chance, with a t-value of 1.7 for the 
comparison between the proportion for the ninety-one cases in 
Table 2 and that for the complementary omitted group of ninety- 
five. This, of course, is to be expected, since the selection process 
was a random one. 

We have been discussing at some length considerations 
involved in the double classification design used here because 
this was necessary to set the stage for the choice of the sample 
actually used in the analysis, and also helps to understand what 
the design is intended to accomplish. The first steps in the 
analysis, however, did not involve the double classification 
scheme, but dealt with the two factors separately, as single 
classifications. That is, we compared the achievement of the 
experimental with that of the control section, ignoring the dis- 
tribution into discussion attendance groupings. Likewise, we 
studied the variation in achievement of the four discussion 
attendance groupings, ignoring membership in the experimental 
or control sections. Then, as the final step in the analysis, we 
dealt with the table of double classification, comparing th? 
achievement of the experimental with that of the control section, 
taking into account the distribution into discussion attendance 
groupings. And vice versa. Comparison of the results in the 
single and double classification analyses then helped answer some 
of the questions we posed at the end of the previous section. 

Assumptions Underlying the Analysis.—Before passing tO the 
discussion of the analysis itself, it would be well to discuss briellY 
the principal assumptions inherent in the application of the 
methods of analysis of covariance: 

1) That the regression of the criterion variable on the variable 
to be controlled (Y on X in our case) is fundamentally the same 
in each of the several cells. 
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2) That this regression is linear. 

3) That the residuals after partialling out the effects of X are 
fundamentally normally distributed in each of the several cells. 

4) That these several normal distributions of residuals all 
have the same variance (assumption of homogeneity of residual 
variance). 

5) That the cases in our sample are random samples from 
each of these populations. 

Not all of these assumptions are equally crucial. There is 
empirical evidence, for instance, that ‘moderate’ departure from 
the normality assumption does not seriously affect the validity 
of the methods. The most crucial assumption is considered 
to be that involving homogeneity of residual variance. We have 
already mentioned that, for the total sample used for analysis, the 
variable Y was approximately normally distributed, and the 
regression of Y on X quite satisfactorily linear. This, of course, 
tells us nothing about the situation in each of the several cells 
of our double classification or about the residuals, but it lends 
plausibility to the assumption that the same conditions hold in 
each of the cells without resorting to an explicit test of these 


assumptions. | 
Because the assumption of homogeneity of residual variance is 
considered to be most crucial, we performed an explicit test of 
this assumption based on the double classification design, since 
Our most important conclusions were to be based on the results 
of the analysis of covariance in the double classification design. 
Using Hartley's M-test, with the tables by Thompson and 
Merrington,!? the obtained M was found to be well within the 
five per cent level of significance for M, and the ана чар 
assumption therefore tenable. Furthermore, homogeneity " 
Tesidual variance in the eight cells of the table of a. 
Classification implies homogeneity of residual eosque mi 
Broups of each of the single-classification analyses perior of 
first, since each of these groups is but a combination of some 
the eight cells. 
_ The Single Classification Analyses.— 
Single-classification analyses—that on 
Sion attendance, and that on discussion 
Method. We have seen that the exper 
-mean appreciably higher than that for the 


Table 3 presents the two 
g discus- 


method, ignoring 1 
attendance, ignoring 
mental group had a 
control section, but 
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we have also seen that there was a difference between the two 
groups in the same direction on whatever student characteristics 
are measured by the variable X, which presumably include inter- 
est and/or ability in this Government course. To what extent 
was the difference between the methods groups on the criterion 
variable Y due to the predetermination effect of this non-com- 
parability in X, or rather, to what extent was it not due to these 
predetermination effects, and therefore, by implication, probably 
was due to the difference between the instructional methods used 
in the two sections? The answer is contained in Columns 11 and 
12 of Table 3. There we see that even with the effects of the 
X-variable partialled out, the F-ratio is highly significant, with 
a probability of arising purely by chance alone only somewhere 
between 25 and Ъ{о of one per cent. We may conclude that, 
barring systematic effects that could bring about this result from 
variables not controlled in this study, the experimental, frequent- 
quizzing method did bring about significantly greater achieve- 
ment on the part of those students to whom it was applied. 
Note that nothing is said in this conclusion about how much, if 
any, of this superiority is due to the greater attendance at dis- 
cussion groups which, we have noted, was apparently motivated 
by the experimental, frequent-quizzing method. This question 
could not be answered until we did the double-classification 
analysis. 

Column 13 gives correlation coefficients which measure the 
degree of the relationship between the X and Y variables. 12 
the row for ‘Total’ appears the coefficient which is the one We 
usually have in mind when we speak of the correlation between 
X and Y over this sample of one hundred eighty-two cases. 
However, we have noticed that the experimental section ha 
both a higher X-mean and a higher Y-mean than did the control 
section—that is, some of this ‘total’ correlation is associated With 
group membership. 'The coefficient in the row for «Within 
Methods Groups’ is a correlation coefficient which measures the 
extent of the relationship between Y and X that is not associate 
with group membership. Itis called, appropriately, the ‘wjthin- 
groups correlation,’ as opposed to that portion of the total rela- 
tionship which is associated with ‘hetween-groups’ differences. 
That it is slightly smaller than the total correlation coefficient 
indicates, as we have already noted, that some small portion 
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of the total relationship is associated with between-groups 
differences. 

The second portion of Table 3 gives the analysis for discussion 
attendance groupings as a single classification. We have seen 
in Table 2 that there is considerable variation in X-means for 
the discussion attendance groupings. The question arises again: 
To what extent is the variation in achievement among the several 
discussion attendance groupings, as measured by the criterion 
variable Y, not due to any predetermination effects of the student 
characteristics measured by X? The answer is contained in 
columns 11 and 12 where we see that, even after partialling out 
the effects of X, the variation in achievement among the discus- 
sion attendance groupings is moderately large, though not quite 
significant at the one per cent level, the probability for the 
obtained F having arisen by chance alone being somewhere 
between two and one-half and one per cent. We may conclude 
as follows: there was a tendency for students who differed on 
characteristics measured by X, which, as we have said, presum- 
ably include interest and/or ability in this course, to differ in their 
frequency of attendance at the voluntary discussion groups; when 
we have removed the effects of this tendency, it appears that 
frequency of attendance at discussion groups is still related to 
achievement in the course, though the relationship is only 
moderate, failing slightly to meet the one per cent level of 
significance. 

Column 13 is interpreted as indicated above. Note that the 
within-groups correlation falls farther below the total correlation 
than was the case in the methods analysis. This implies that 
more of the total relationship is associated with variation among 
discussion attendance groupings, than was the case for method- 
group differences. 

Let us now summarize the conclusions we have been abl 
draw so far from our experimental data. Even when the pre 
determination effects of the student characteristics measured РУ 
X are partialled out, we have seen that there is still a highly 
significant difference in achievement in the course between the 
experimental and the control sections, and we have also seen tha 
attendance at the discussion groups bears a relationship 
achievement in the course. Now, however, we have observe 
in Tables 1 and 2 that discussion attendance behavior differe 


e to 
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markedly between the two sections—the ‘attenders’ in the experi- 
mental, frequently-quizzed section were motivated to attend 
many more discussion groups, on the average, than were the 
attenders in the control section. The following question now 
arises: how much of the significant superiority in achievement 
of the experimental section over the control section can be 
explained by the greater attendance at discussion groups which 
Was motivated in the experimental section? Can all of it be so 
explained? If not, how large (how significant) is that part which 
cannot be so explained? The double classification analysis to 
follow undertook to answer these questions. 

The Double Classification Analysis.*—The double classification 
malysis is presented in full in Table 4. Неге the tests of the 
rene between the two methods groups are tests taking into 
tw she variation in discussion attendance. Similarly, the 
ta ei or variation among discussion attendance groups are tests 

‘ng into account method-group membership. a 
acne Папа 12 give the significance tests on variation in 

levement after partialling out X. We see that the F-ratio 
п. method has been drastically reduced from that in the single 
“Ssification, This reduction is due to the fact that attendance 
of qa cem groups is now being taken into account in à test 
Ше. a between the methods groups; the methods per 
attend їп their discussion attendance behavior, and ee 
Simi] ance was related to achievement in the course (Ta e 3). 
“arly we see that the F-ratio for variation among discussion 
€ndance groups is reduced over that in Table 3. | 
Whe e result of greatest interest to us, however, is that, ж) 
П We take differing discussion group attendance into ае 
aut Partial out X, there still remains a ЕДЕБИ ie А 
TImenta] group over the control group of considerable mag 


; H 
in ere shall not БО into a detailed explanation of a new Ano eee 
Meth, ouble classification design—the so-called ‘Interaction’ efiec ed 
es PP. discussion attendance, because it plays no importan 2d 

It must be included, however, in order to make шы ane 
r ы In fact, in the analysis of Table 4 the Interaction, epos 
bine P insignificant, and was combined with ‘within-cells to a - 
Metho řesidual” error estimate to be used in testing he €: air with 
the t and attendance at discussions. We are therefore dea g 


W 
9 main effects in Table 4. 
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nitude, the obtained F-ratio having a probability of arising by 
chance only somewhere between two and one per cent. That is 
to say, when we remove the predetermination effects measured 
by x, and when we remoye the effect of disproportionate distri- 
bution of discussion attendance, there still remains a superiority 
10 achievement of the experimental section over the control sec- 
tion that barely falls short of being significant at the one per cent 
level, 

We are now in a position to answer the question which we posed 
Ourselves at the end of the preceding section. Tt is clear, first, 
that frequent quizzing did bring about greater achievement in 
: 18 course. But we can now say, further, that while some of 
this greater achievement can be explained by the greater attend- 
mm at discussion groups (on the part of attenders) which the 
н quent quizzing apparently motivated, by no means all of it 
| n be so explained; there remains a superiority which cannot 
levels explained that falls between the two and the one per cent 

of significance. 
pried, we can do more; we can trace the principal soure 
ĖS remainder. In Table 5, in the column headed W,D,, we see 


e of 


Tan 5 А 
LE 5.—DounLE Cuassirication, Метнор х DISCUSSION 


ATTENDANCE: EXTRACTED Portion FROM TABLE FOR 
ESTIMATION or SUMS OF SQUARES AND PRODUCTS 


Discus i 

tendera W, = Mates Dg, - Ja =a Ya тр», 
1-14 10.88 +1.96 +21.4 
=й 8.06 43.47 +27.9 
аб. 6.97 49.93 +69.2 
None 16.5 +7.39 4122.0 
Total 42.41 +240.5 


t i 
0 by far the largest contribution to ZIW. Dr, comes nes "e 
low senders, and the next largest contribution comes ci a 
tion tenders in the 1-2 group. This means that pe ei : a 
ba the methods difference which remains 81911 пса This 
le classification of Table 4 is due to these two PUE йб 
€ interpreted as follows: the high attenders in the е? 


cere expecte 
ental section had high achievement, but they were exP 
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to have high achievement; their counterparts in the control sec- 
tion also had high achievement, so that the high attenders 
contribute little to the methods difference in the double classi- 
fication of Table 4 (although they contributed a great deal to the 
methods difference in the single classification of Table 3, where 
discussion attendance was not taken into account, because there 
were a great many more of them in the experimental section than 
there were in the control section); on the other hand, low- and 
non-attenders in the experimental section apparently achieved a 
great deal more than their counterparts in the control section, 
and it is these groups that account for the significant methods 
difference that remains in Table 4. We are thus led to speculate 
that the frequent quizzing method, besides motivating greater 
attendance at discussion groups on the part of attenders, also 
motivated greater outside endeavor with respect to the course, 
which we have no measure of in this study; moreover this greater 
outside endeavor shows up dramatically in the case of the 10%- 
and non-discussion group attenders, which accounts for the 
significant methods difference still remaining when discussion 
attendance is controlled in Table 4. , 
It is of considerable interest, from the point of view of statis- 
tical methodology, to note that the question which we pose 
ourselves at the end of the last section, and have now answere : 
could not have been answered without resorting to the nom 
orthogonal case, Assumption B. Even those research ane 
who occasionally use the non-orthogonal case tend to look up? à 
it as an inconvenient nuisance, made necessary by bad luck, 0 
bad planning, or both, that would have been better ae 
This may frequently be true, especially when Assumption oly 
the appropriate one (that unequal cell frequencies are eni 
chance sampling effects). But here we had a situation where bó 
disproportionate frequencies are clearly characteristic 0 the 
classificatory factors under study, and proceeding under và 
non-orthogonal case, Assumption B, we have been able to ans" » 
a question about our experimental results which could not othe 
wise have been answered. 4 is 
Since the test of discussion attendance variation in Table ori- 
not of major interest in drawing conclusions about ou” wr 
ment, we shall not discuss it in detail, but shall only HE. p 
when group membership is controlled, as well as X partialle 
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We see in Column 12 that the variation among discussion attend- 
ance groups drops below the five per cent level of significance. 
Column 13 may be interpreted as previously indicated. 


SUMMARY AND CONCLUSIONS 


А non-orthogonal case (disproportionate frequencies) of analy- 
8 of covariance is demonstrated in the investigation of an 
dependent educational variable in relation to another variable 
Тн differentially distributed in the experimental and control 
groups. 

, Frequently-quizzed students in Government have significantly 
‘igher achievement than students receiving only monthly quizzes, 
ides after a predetermining index of ability in Government has 
cen partialled out. 

his superiority is accounted for only in part by voluntary 
ad eadanco at discussion groups in Government conducted in 
tion to class lectures. Even when discussion attendance 
rte 4s predeterminers of ability are taken into aec dee 
One Bs of the frequently-quizzed students is p a 
ac ie Much of this superiority is attributed to t e m * 
few ini of frequently-quizzed students who иши i a 
Thiet а groups over the achievement of non- req 
“ Students who attended no or few discussion groups. 

Itional evidence suggests that frequent quizzing motivates 
tudents to attend more discussion groups. 
n the basis of these findings we may conclude that frequent 
116 of achievement in the college lecture classroom may moti- 
" Such outside endeavor as will result in superior pec 
vig i trüetor who wishes to use such poma ieri 
insta, oti accompany lectures would do well to make ee 
this ctiona scussion g an 
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& VALIDITY STUDY OF PERSONALITY QUESTION- 
NAIRES AT THE UPPER ELEMENTARY GRADE 
LEVEL* 


WILLIAM J. LODGE 
Professor of Education Chico State College 


THE PROBLEM 
умы appraises the validity of a direct and an йө 
sixth. n Becta and attitude questionnaire at the fifth-, 
with E. seventh-grade levels, as measured by correlations 
indivi "à A criteria and by an analysis of responses to the 
effects ual items. The study also offers evidence bearing on the 
terene questionnaire responses at these grade levels of the 

he ene non-requirement of signatures. 
Ellis: roe P or aent was designed to evaluate and extend a study by 
indirect : oa: two forms of direct and two forms of equivalent 
in An Кош were combined into one measuring instrument 
еее ort {о determine which form could best distinguish 
£rade чи groups of ‘normal’ and ‘problem’ seventh- and rd 
indirect ТЫ None of the four forms did so distinguish, eye 
Ellis as Ta used in the present investigation was нарс à 
in the fis 1е most promising. Examples of the two types emp oye 
irect: ipeum Study are as follows: 
flery 
Meg often Pretty often Seldom Never 
? Children who often cry are | 
Eli Y queer Pretty queer A little queer Not at all quer 
S? theory, (4) which is not confirmed by the present exper! 
| 15 that children who themselves possess the жиди iia 
‘No =) crying will classify other children Жш Se e в 
tating um queer,’ and that, in effect, the child, У ved uem = 
атас пег boys and girls, will actually be revealing 
€ristics, 
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terms, a high degree of validity and reliability. The 


22 The Journal of Educational Psychology 


thirty-six used by Ellis.'* They were obtained by him from a fre- 
quency count of the items employed in eight popular personality 
inventories. Five Hartshorne and May? ‘ringer’ items} and 
seven cheating attitude questions based on a review of the litera- 
ture were added by the writer. The foregoing forty-three items 
were drawn in random order and were then written in direct and 
indirect form respectively, in the order drawn by chance. Split- 
half Pearson r’s based on one hundred and one cases for the direct 
form and one hundred and five for the indirect were .83, P.E. = 
.02 and .86, P.E. — .02, respectively. 

The comparison between the two forms of the questionnaire is 
based on the administration of the instrument by the writer to 
two groups of two hundred forty-four children each, matched for 
grade, sex, IQ, reading comprehension and socio-economic status. 
The subjects were drawn from five California publie schools. 
One-half of the children in each group were tested with signatures 
required and the other half anonymously, with identification 
subsequently accomplished by the experimenter by means 0 a 
pinprick code system. The questionnaires were administere¢ 
a second time one week later by the classroom teachers. { 

The ‘personality’ items on the questionnaire were scored m 
accordance with the system developed empirically by Ellis! ; 1-8: 
one point was scored on the direct form for cach ‘Very often' oF 
‘Pretty often’ answer and no points for each ‘Seldom’ or ‘Never 
response. The indirect form was scored one point for each ‘Not 
at all queer’ reply and no points for the ‘Very queer,’ «Pretty 
queer, and ‘A little queer’ answers. The cheating attitude 
questions were scored in the same way except that ‘Seldom 
answers on the direct form were also scored one point, since they 
obviously constitute a cheating admission. 

A social status score for each child was determined bY the 
administration on the fourth day of a sociometric instrumen? ру 
the classroom teachers. This instrument employed t 
criteria used by Flotow,? involving up to three choices of cl 
with whom the child would like to work and play and ene 


whom he would like to sit. Flotow reports, in non-quantita, 
| directio”! 
and 
* By permission of the American Psychological Association, Ine» 
Psychological Monographs. 


1 By permission of the Macmillan Company. 
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to the children followed closely the pattern recommended by 
Moreno: to obtain maximum validity. 

Each child's social status score as employed in this study was 
determined by caleulating the total number of times he was 
chosen by others, with specific criterion and one-two-three order 
of choice disregarded. 

The Van Wagenen Unit Scales of Achievement: Reading Com- 
Prehension Tests? were administered on the twenty-first day for 
the dual purpose of obtaining standardized reading comprehen- 
Sion scores for matching and correlational purposes and to con- 
trol a classroom cheating experimental situation. The papers 
Were scored by the experimenter with no marks recorded on them 
and then returned promptly to the children, ostensibly for self- 
Scoring, A cheating behavior rating was subsequently deter- 
mined for each child by dividing the difference between his true 
Score and a perfect score into the number of points he raised his 
Score, if any, | 

Finally, socio-economic ratings were determined, by converting 
Parent's occupation in accordance with the Barr Scale Ratings of 

Scupational Status? (66-72). 


STATISTICAL FINDINGS 
Table I shows that the direct and the indirect forms of the 
questionnaire are significantly different according to a rigid chi- 
quare test which was used because of the skewed distribution of 
1 data, Correlations of various sections of the questioni a 
Ton YET, with external criteria (Table III) suggest -nn 
in a POssesses much validity as measured. The r’s in E 
Icate some superiority for the indirect form, but posi 


indi rm and 

in Ku personality problems as scored by the ной Y atus 
€ligenee. readine c е sion, апа socio-econom a 

e, reading comprehension, heory held by 


ie IV) are interpreted as meaning that, if the t pee 

18! and by others is tenable, superior children ten мн 
Bteater number of personality problems than do those “a iem 
aean, Tt might be maintained that the more ШЕКЕ atis " 
8 5 more self-critical, which would be reflected in higher маа) 
meres, but, neither the literature generally nor the item 


(т hesis. 
ables V, VI) particularly supports such an hypot n effect, rate 


* data suggest that many children do not, in but do 
themselyes when they respond to most of the indirect items 
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TABLE I.—CompaRISON OF THE DIRECT Form or PERSONALITY 
QUESTIONNAIRE WITH THE INDIRECT Form: UNFAVORABLE 


RESPONSES 
aon ; Chi 
Direct | Indirect Sunre Signif- 
Category of P icance 
T evel 
N [Mean] N |Mean| Differ nas 
ence 
Personality Score, 
1st Testing* 244) 6.20 /244/11.93] 64.24 |.01| 1 per cent 
Personality Score, 
2nd Testing* |244| 5.29 |24412.64| 65.01 |.01| 1 per cent 
Cheating Attitudes, 
1st Testing 244| 1.79 [244] .95| 6.74 |.05| 5 per cent 
Cheating Attitudes, 
2nd Testing 2441.90 |244| 1.05| 8.00 |.02| 5 per cent 


* Includes the following sub-categories, each of which were significantly 
different at either the one or five per cent level; fears, school adjustmer » 
sensitivity and excitability, psychosomatic symptoms, and social adjusimen” 


TABLE II.—Comparison or THE ANONYMOUS Group WITH TH 
SIGNATURES-REQUIRED Group: UNFAVORABLE RESPONSES 
TO THE PERSONALITY QUESTIONNAIRE, First TESTING 


Anonymous Signatures : is 
Required | Square 
Category of 
Differ- 
N |Mean| N |Mean ence 
Personality 
Score* 244 | 8.72 | 244 | 9.42 3.62 
Cheating 
Attitudes | 244 | 1.14 | 244 | 1.59 2.29 


* Includes the following sub-categories: fears, school adjust 
tivity and excitability, psychosomatic symptoms, and social adju 


д! 
justment, se 


signif- 
р | icance 
Level 
ME ся 
29 | NS 
130 | N$ 


выпер“ 


si- 
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Tarte III.—Comparison or SECTIONS OF THE INDIRECT AND 
Direcr Forms or THE PERSONALITY QUESTIONNAIRE 
THROUGH CORRELATIONS WITH EXTERNAL CRITERIA: 
First TESTING 


Tetrachoricr| Chi zd 
Questionnaire External N i xw Р ү 
Section Criterion Direct In- Differ- Level 
direct} once 
Social Adjustment | Sociometric 
Problems Rating — 488|--.20 | —.21 | 39.52 |.01| 1 per cent 
Cheating Attitude Cheating 
Admissions Behavior |403|--.08 |4-.25 1.03 |.90 NS 
School Adjustment Intelligence 
Problems Quotients S8|4-.17 |—.19 | 49.07 |.01| 1 per cent 


—— ÉD CL —— 


TABLE IV.—ConnELATIONS or TOTAL PERSONALITY Sconzs* or 
THE Dirwer AND [INDIRECT FORMS or THE QUESTIONNAIRE, 
ESPECTIVELY, WITH EXTERNAL CmtveRt: Frnsr Testina 


Tetra- Chi 


Ex chorier  |Square Signif- 
iion ЫМ |] Ыы Р | icance 
Criterion | Indi- | Difer Travel 
Direct rect | ence 
Intelli 
. gence Quo- 
tients 488| —.15| +.31| 69.05 | -01| 1 per cent 
°io-Economie 
Status 488| —.13| +.06| 69.77 | .01 1 per cent 
fading Co 
-ompre- À 
hension 488 | —.04| +.28| 53.07 | .01 1 per cent 
bs 1 t, sensitivity 
and bes Personality score’ includes fears, school epis 


bility, psychosomatic symptoms, and socia 

рн Other children, as instructed, and that or HP it difficult to 

hee Cases do so rather tolerantly. One - and forty-four 

chia Tor example, that out of two hundred tely one-half 

„Пате responding to the indirect form, a й school work 
Mong (1) find it difficult to speak out in class or do 


superior children 
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an 3 PER- 
TABLE V.—NUMBER OF UNFAVORABLE RESPONSES TO y dm 
soNALITY AND CHEATING ATTITUDE lrEMS OF THE Qu 


r 


TIONNAIRE: First TESTING* 


Direct Indirect 
Nature of Item N = 244 N = 244 
Finds it hard to speak out in class 85 y 
Would rather play by self than with others 18 EA 
Often becomes gloomy or sad 49 = 
Is afraid of high places 58 
Often has headaches 50 EU 
Dislikes school 48 5 
Cheats to get good marks and please parents 69 3 
Often has horrible dreams while sleeping 31 i 
Cheats to get good marks and keep up with 33 
friends or brothers or sisters 48 
Cheats if knows that other children are 32 
cheating 62 
Feels that teachers treat him badly or 61 
unfairly 14 53 
Feels that people often find fault with him 55 4 
Is afraid of being followed when walking on 81 
the street, 43 148 
Is afraid of fire 80 135 
Often feels ill or weak 26 59 
Often day-dreams 87 20 
Cheats if believes will not be caught 51 
Is often bothered with pains in some part of 147 
his body 45 34 
Feels that nobody really loves him 17 
Cheats on tests in school if the tests are hard 34 
and unfair 84 
Cheats to get good marks and please the 25 
teachers 45 61 
Feelings are easily hurt 100 107 
Finds it hard to become a leader 77 69 
Is afraid of the dark 33 
Often feels tired when he wakes up in the 116 
morning 105 103 


Stutters or stammers 14 
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TABLE V.—Continued А 
Direct Indirect 


Nature of Item N = 244 N = 244 
Has habit of twitching his neck or face 13 46 
Bites his nails 85 53 
Finds it hard to get along in school 25 57 
Cheats if thinks the teacher is unfair 72 30 
Often becomes excited 125 120 . 
Finds it hard to make friends 20 81 
Other children refuse to play with him 17 70 
Often cries 29 67 
Finds it hard to do his school work AT 110 
Is afraid during bad storms 24 96 
Often feels tired during the daytime 33 106 


* ‘Ringer’ items are omitted. 


right, (2) often have headaches, pains in some part of the body, or 
feel ill or weak, (3) often have horrible dreams while sleeping, 
wake up tired in the morning, and remain so all day, (4) have 
their feelings easily hurt, and (5) are afraid of high places and of 
fire. 

One may also doubt that in a group of two hundred and forty- 
four ‘normal’ fifth-, sixth-, and seventh-grade children (1) more 
than one-third are afraid of being followed on the street, (2) more 
than one-third stutter or stammer, (3) other children refuse to 
play with almost one-third of the group, (4) more than one-fifth 
bite their nails, and (5) almost one-fifth habitually twitch their 
necks or faces. . | 

Table V indicates that the approximate two-to-one ratio 
between number of alleged personality problem ‘admissions’ 
on the indirect and direct forms, respectively, was reversed in the 
case of cheating attitude questions. The reasons for this rever- 
sal are not clear from the available data, but it is hypothesized 
that many of the children in the indirect group did make the 
identification and transfer when confronted with threatening 
items, and, realizing the implications involved in the cheating 
ade fewer admissions than did the direct 
group. Itseems probable. that the indirect method will yield some 
‘neurotic’ admissions that the direct method, with its bludgeon- 


like attack would miss. But the indirect approach employed in 
Я 58. 


questions, cautiously m 


e. 
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this investigation will score a great many ‘normal’ responses 45 
‘neurotic’ or ‘unfavorable.’ In more conerete terms, a child, for 
example, who replies that children who are afraid of high places 
are ‘Not at all queer’ is not necessarily, or even probably, admit- ` 
ting that he himself is afraid of high places. 


ante VI.—Numper or UNFAVORABLE Responses TO THE 
‘Ringer’ ITEMS oF THE PERSONALITY QUESTIONNAIRE: 
First TESTING 
Direct Indirect 


Nature of Item N = 244 N = 244 

Keeps other children quiet when the teacher 

is out of the room 99 192 
Picks up broken glass lying in the street 72 156 
Smiles when things go wrong 92 112 
Reports to the police the license numbers of 

speeding automobiles 27 162 
Reports to the teacher other children whom 

he sees cheating 33 69 


Subject to further research involving the effects on the results 
of an examiner who is a stranger to the children and/or the 
influences of the individual classroom teachers, Table II points to 
the conclusion that anonymity of responses is not а major factor 
in personality and attitude testing at the grade levels here con- 
sidered. In fact, differences, while not significant by chi-square 
test, indicate a greater number of unfavorable admissions for the 
signatures-required group for both the personality and cheating 
attitude items. 

SUMMARY AND CONCLUSIONS 

This study evaluates certain aspects of the validity of a direct 
and of a parallel indirect form of personality questionnaire, H 
of the items for which originated with eight popular commerce!" 
personality questionnaires. The direct form openly asks the ¢ 
about himself, while the indirect form requests his opinio б 
children. The theory advanced by several experimenters MEX y 
confirmed in this study, is that children, although ostens", 


: 51108. 
rating others, will actually reveal their own characteris 
ove 


Finally, additional evidence is offered regarding the contr 


== . —— 


5 ^ 
ranger to the children, and of the classroom 


Der 
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issue of the effects on responses to personality questionnaires of 
the requirement or non-requirement of signatures. 

Four hundred and eighty-eight fifth-, sixth-, and seventh-grade 
California publie school children were matched in groups of two 
hundred and forty-four each in order to compare the direct form 
of the questionnaire with the indirect and the requirement or 
nonrequirement of signatures. Questionnaire scores for each of 
the matehed groups were compared directly and were correlated 
with sociometric ratings, intelligence, reading comprehension, 
socio-economic status, and cheating behavior as measured 
experimentally. 

Correlations of the social adjustment, school adjustment, and 
cheating attitude sections of both the direct and the indirect forms 
of the questionnaire with sociometric ratings, intelligence and 
cheating behavior, respectively, and of total questionnaire scores 
with intelligence, reading comprehension, and socio-economic sta- 
tus indicate (by these criteria) virtually zero validity for the direct 
form and a very low degree of validity for the indirect. These 
correlations, when considered with the item analysis and the 
significantly different mean scores for the two forms strongly sug- 
gest—if they do not conclusively prove—that a number of chil- 
dren sufficient to invalidate the indirect form of the instrument 
respond as instructed with their opinion of others and generally 
do not make the personal identifieation suggested by several 
previous studies. The blunt, direct form of the questionnaire 
is regarded as invalid and unpromising and the indirect form as 
requiring considerable refinement before it can be applied uncriti- 
cally. Many individual questionnaires which might be useful to a 
skilled clinician were undoubtedly to be found among both the 
direct and the indirect groups in this investigation, But the 
writer joins many previous investigators in cautioning against 
the making of unwarranted assumptions regarding the validity 
of this type of instrument for survey purposes. 

The mean number of ‘neurotic’ or unfavorable responses by the 

; " Tod rou 
ШШ ЕШ ШЛ group exended n epo s E 
Put differences were nol significant, Suh ши wh З 
volving the effects on responses of an escam 


y factor in 
18 concluded that anonymity of response 18 > e 
Sonality questionnaire testing at these grade levels. 
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ACADEMIC ACHIEVEMENTS OF VETERANS AND 
NON-VETERANS AT THE CITY COLLEGE OF 
NEW YORK* 


LOUIS LAURO anv JAMES D. PERRY 


Division of Testing and Guidance 
The City College of New York 


INTRODUCTION 


The question of Federal aid to education and its extension to 
higher education is still an unresolved issue. It seems appropri- 
ate, therefore, to gather as much information as possible on the 
most recent large-scale subsidization of education through the 
* G. I. ВШ” 

The consensus of college professors seems to be that the vet- 
егапз are better students than their non-veteran classmates. 
This assumption is supported by published reports, but in many of 
these studies certain essential controls needed to make this 
conclusion a valid one have not been introduced. 

Unless a non-veteran group is introduced, veterans’ scholastic 
performance can be compared only with their pre-service records, 
and observed differences might be attributable to factors other 
than the service experience. Studies which did not introduce a 
non-veteran control group are of limited interpretative value, 1.8 
If a non-veteran group is to be introduced, the factor of scholastic 
aptitude must also be controlled. This was done by one investi- 
gator through the use of analysis of co-variance techniques, !? by 
others through matched control groups,* while still others merely 
reported mean scholastic aptitude test scores or high-school 
averages for the groups under consideration.9:99 These investi- 
gators reported veterans to be equal to, or superior to, non- 
veterans. Onereport, especially noteworthy because it comprised 
several thousand students in colleges throughout the country, 
indieated that differences between veterans and control groups of 
non-veterans were consistently small and in favor of the veterans 
in the majority of cases.!?? In a special program for veterans with 
irregular scholastic records, the veterans achieved a higher mean 
college average than did women in regular attendance at the 


* The writers wish to thank Dr. Louis Long for his many constructive sug- 
gestions, and the staff members of the Veterans Counseling Office for their 
assistance in recording the data upon which this study is based. 
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college, in spite of the fact that the mean high-school average 
of the women was above that of the veterans. 

The failure of some investigators*?.9.!? to control the factor of 
scholastic aptitude leaves as an unknown a variable which might 
affect results. These investigators did find slight differences 12 
favor of veterans, but only one? considered the statistical signif- 
icance of the difference and in this case the difference was not 
significant. Similarly, in a study which made reference to 
scholastic aptitude measures for only part of the cases, А very 
slight difference in favor of veteran students was reported, but à 
test of significance was lacking.!* ә 

On the assumption that students’ performances in certain 
college courses are indicative of over-all academic achievements, 
one course might be selected as a focal point for investigation. 
However, failure to substantiate the assumption severely limits 
the interpretation of the results. For this reason, it appears 
unjustified to extend to over-all achievement the finding that 
veterans surpassed non-veterans in Freshman English." An 
investigation centering about grades in general chemistry must y^ 
considered inconclusive since there were only eight subjects M the 
non-veteran group.” 

An attempt to demonstrate that age was the only factor ™ Я 
for the slight superiority of veterans indicated that non-veterem 
made better grades than did veterans of the same age- e 
ever, when one considers the upward trend of grades through к e 
later college years, it becomes apparent that the failure to jg 
grade placement into account biases the results against veter? 
Furthermore, other investigators found no correlation 
age and academic achievement of veterans? or slight ne 
correlations for both veteran and non-veteran groups.” 

There is a good deal of variation in the relative 80 
achievement of veterans and non-veterans from colles? ^. way 
lege. No institution reported any very dramatic results one є ps 
or the other; however, slight differences in favor of tl 
seem to be the norm. Age does not appear to be a factor и D E 
ing these differences. Apparently the service experience; 
does contribute to them. 


aking 


polasti? 


SCOPE OF THE STUDY the 


Га 1 i m 1 
The purposes of the present study are: (1) to investi. riot 
average grade-point differences between pre- an Re 
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periods of veterans attending City College (2) to compare vet- 
erans’ averages with non-veterans’ averages, and (3) to determine 
whether there are any differences between veterans and non- 
veterans with respect to choice of course of study (including 
nature of changes in study program). 

The subjects of this investigation are students who were 
enrolled as lower seniors in the fall semester of 1948 in one of the 
following courses of study: science, social science, or technology. 
The records of six hundred twenty-nine male students were ob- 
tained. However, a number of these students were not included 
since they fell into one or more of the following categories: 

1) Students who did not attend City College before entering 
service. They had either entered college for the first time after 
their return from service or had taken a full semester’s work or 
more at another institution. 

2) Students who had attended Evening Session at City College 
before entering the service or who had less than ten pre-service 
credits. 

3) Students who were taking training under Public Law 16 (the 
law covering training of disabled veterans). 

4) Students who were twenty-one years of age or more at time 
of entrance. 

Data relating to the final sample will be found in Table 1. 


TABLE 1.—DESCRIPTION or FINAL SAMPLE 


Classifica- 

tion of Original Number Final 

Course Students Sample Excluded Sample 
Science Veterans 66 18 48 
Science Non-Veterans 44 2 42 
Social Science Veterans 104 45 59 
Social Science Non-Veterans 85 13 72 
Technology Veterans 240 120 120 
Technology Non-Veterans 90 g 73 


Most of the veterans entered the College between September, 
1941, and September, 1944, while most of the non-veterans 
t ж between February, 1945, апа February, 1946. The mean 
ente t entrance for the two groups was approximately seventeen 


M with standard deviations varying from 


years and four months, 
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seven to ten months.  High-school averages and scores on the 
ACE Psychological Examination were recorded for all those 
students for whom thisinformation wasavailable. In Table2, the 


TABLE 2.—Meran HIGH-SCHOOL AVERAGE AND MEAN SCORE ON 
ACE PSYCHOLOGICAL EXAMINATION FOR VETERANS AND 
Non-VETERANS 


Veterans Von-Veterans 
Mieasira of Non-Veterans 


Course Scholastic 


Aptitude |N| M |SD|N| M |SD ap 
Science ACE 40/121.8]18.4| 39]124.7|21.7| .64|.26 


High-school 


Average 38| 83.7| 4.0| 40) 85.1) 4.5)1.46).07 
Social ACE 55/116.8/16.8| 70117.0/22.1| .06|.48 
Science High-school 

Average 50} 82.8| 3.9| 68| 83.4) 4.8) .75|.23 
Technology| ACE 971119.7]16.7| 65/126.0/15.9/2.42].01 


High-school 
Average 94| 83.8| 3.8| 63| 84.9) 4.11.09.05 


—— O S E a 


mean high-school average and the mean score on the ACE Psy- 
chological Examination are listed for veterans and non-veterans. 
The differences between the means and the reliabilities of these 

differences are also presented in Table 2, The greatest difference 
between veterans and non-velerans is found in the technology 
group, where significant differences between the mean high-schoo 

averages and mean scores on the Psychological Examination are 
found in favor of the non-veterans. These differences may Pe 
due to variations in admission standards. 


METHODS OF TREATING THE DATA 


The effect of variations in amounts of college work, taken in the 


pre- and post-service periods, upon academic achievement lin 
partially controlled by dividing the veterans into two group? 


Group A consisted of those veterans who had completed eleve? 
to thirty-two credits in the pre-service period. Group B pod 
re 


sisted of those who had completed more than thirty-two © 


ыў 
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in the pre-service period. In order to compare Groups A and B 
in terms of scholastic ability, the mean of the scores on the 
Psychological Examination was computed for each group, accord- 
ing to course of study undertaken. The difference between the 
means of Groups A and B was 0.1 for the science students, 4.1 for 
the social science students, and 1.6 for the technology students. 
None of these differences were found to be statistically significant. 

The pre-service grade-point average and the post-service 
grade-point average for veterans were determined by dividing 
the grade-point * by the number of credits taken during the appro- 
priate period. 

In order to study the question of whether college grades tend to 
improve as students progress in their college work, the college 
grade-point average of the non-veterans was determined at the 
end of the first, second and third years. The procedure used in 
calculating these grade-point averages was the same as that for 
the veterans. 


RESULTS 


A trend among veterans toward professional and technical 
training, found by Tibbets and Hunter," is also apparent among 
the veterans in this study. Of the three courses of study which 
Students in this investigation were taking, technology was being 
taken by more than a proportionate number of veterans, while the 
Non-veterans had tended to take science and social science 
Courses. This trend held despite the fact that many veterans 
had transferred from the School of Technology to other courses of 
Study. Table 3 indicates the number that have transferred to 
Science or social science in their most recent degree change. The 
Teason that the number of veteran technology students still 
Temains high, despite this drainage, is that the vast majority 
of them entered college during the war years, when interest in 
engineering was at its peak. The Registrar's tabulation of 

€gree choices of entering freshman for the semesters beginning 
February, 1942, to February, 1944, shows that forty-four to forty- 


аа, 


* The grade-point was computed by giving each credit of Aa weight rs plus 
two, each credit of B a weight of plus one, each credit of C a weight o udi 
each credit of D a weight of minus one, and each credit à a weight o 
minus two; the sum of the weighted credits is the grade-point. 
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TABLE 3.—Naroure or Моѕт RECENT CHANGE OF COURSE BY 
VETERANS AND NoN-VETERANS 


Course Veterans Non-Veterans 
Per Cent Per Cent 
f Sample | ,. | of Sampl 
ч to: D : Т o р ре 
Changed to бат Я Transfer- m Transfer- 
ring ring 
Science Technology 26 54 8 19 
Arts 1 2 0 0 
Business Admin- 
istration 0 0 1 2 
27 56 9 21 
Social Science | Technology Lf 19 2 3 
Science 19 32 8 11 
Arts 6 10 5 7 
Business Admin- 
istration 3 5 6 8 
Education 2 3 4 6 
Unspecified 1 2 0 0 
42 71 25 35 
Technology | Science 7 6 0 0 
Unspecified 2 2 0 0 
B] | ини 
9 8 0 0 
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nine per cent of all freshmen entered the School of Technology, 
whereas in the semesters beginning February, 1945, to February, 
1946, inclusive, only twenty-eight to thirty-four per cent of all 
freshmen entered this School. These two periods correspond 
closely to the years when the veterans entered and to those when 
the non-veterans entered, respectively. The veterans were 
apparently not influenced by the post-war trend away from 
technology. Table 3 shows that very few students transferred to 
the School of Technology, so that almost all of the students in this 
School at the time of this study began their college careers in it. 

In Table 4, the mean pre-service grade-point average of the 
veterans in the School of Technology is presented along with the 
mean grade-point average of non-veterans in the same School for 
two equivalent periods of time. Differences of .21 (for Group A) 
and .22 (for Group B) of a letter grade are found in favor of the 
hon-veterans; both differences are significant at the one per 
cent level. In the post-service period, however, veterans in 
Group A exceeded the scholastic achievement of non-veterans by 
13 of a letter grade (Р = .03). On the other hand, veterans in 
Group B did about as well in the post-service period as non- 
Veterans in an equivalent period. The mean high-school aver- 
age and ACE Psychological Examination score of veterans and 
non-veterans in the School of Technology (see Table 2) presaged 
Poorer scholastic achievement on the part of veterans. Despite а 
slightly lower mean ‘scholastic aptitude,’ veterans equalled or 
exceeded the achievement of non-veterans. 

The data are not as clear-cut in the case of the other degree 
groups (Table 3). Fully seventy-one per cent of the veterans 
and thirty-five per cent of the non-veterans taking the social 
Science course had changed to it from another course; fifty-six 
Per cent of the veterans and twenty-one per cent of the non-vet- 
erans taking the science course had changed to it from another 
course. This means that there has been a wide range of subjects 
taken in the first year or two; the difference is especially marked 
between those who had taken an engineering course and those who 
had taken a non-engineering course. These differences must be 
borne in mind even when comparing veterans with non-veterans 
taking the same course. . А 

The veterans who were taking а science or social science course 
as of September, 1948, and who had taken a year or less of college 
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work in the pre-service period, had mean grade-point averages 
for this period of —.12 and —.08, respectively, (equivalent to a 
letter grade of slightly less than ‘C’). Non-veterans taking a 
science course obtained a mean grade-point average of .66 (B—) 
for an equivalent period, and those taking a social science course, 
а mean grade-point average of .29 (C+). In the case of the 
veteran group, the uncertainty of whether or not they would be 
drafted before the end of the semester, coupled with the enroll- 
ment of many of them in the Engineering School, when a large 
percentage probably lacked the aptitudes for technological train- 
ing, are suggested factors contributing to poor scholarship. On 
the other hand, those of the veteran group who were able to 
Complete more than one year of school work in the pre-service 
Period fared much better during this time with mean grade-point 
averages of .35 for the science and .20 for the social science groups. 
However, in an equivalent period, the non-veterans still surpassed 
the veterans with mean grade-point averages of .66 for the science 
and .36 for the social science groups. 

The post-service period gives an entirely different picture. 
Groups A and B of veterans taking a science or a social science 
Course all showed increases in mean grade-point averages over the 
pre-service period. The non-veterans taking a science course 
Were apparently a superior group from the beginning. Although 
both Groups A and B of the veterans taking a science course 
Showed a marked improvement in the post-service period, they 
Were not able to equal the consistently high performance of non- 
Veterans. More than half of the veterans taking a science course 
had transferred from the School of Technology; these had 
Started off with a poor adjustment to school work. This poor 
initial performance may have projected its effects to the time after 
the transfers had been made. Of veteran students taking a 
Social science course, Group A obtained a mean grade-point 
average of .65 in the post-service period while non-veterans taking 

€ same course obtained a mean grade-point average of .61. 
However, this slight difference in favor of the veterans is not 
Statistically significant (P > .05). Group B also obtained a mean 
&rade-point average of .65 in the post-service period but non- 
Veterans obtained a mean of .75; the difference between the means 
15 significant (Р = .01). 

Group A of the veterans taking a technology course surpassed 
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the B group in mean post-service grade-point average, although 
the mean pre-service grade-point averages of both groups had 
been very close. Group A, it may be recalled, is the group which 
had one year or less of college training before entering service. 
Therefore, for the technology students, the service experience 
appears to have had a beneficial effect on academic achievement. 
The comparison of Groups A and B of veterans taking the other 
courses is complicated by the variation in pre-service mean grade- 
point averages. Group A of veterans taking a science course 
showed a greater improvement in the post-service period over the 
pre-service period than did Group B. However, Group B still 
surpassed Group A in mean grade-point average. On the other 
hand, Group A of the veterans taking a social science course, 
whose academic achievement was less than that of Group B in the 
pre-service period, equalled Group B in the post-service period. 
The difference with respect to relative achievements of Groups A 
and B between veterans taking a science course and those taking 
а social science course may be explainable in terms of differences 
between the nature of the two courses. Success in advanced 
work in the science course is more dependent upon a good founda- 
tion in certain elementary courses than is the case in the social 
science course. In the social science course, the materials covered 
in the various subjects are not as interdependent. 


SUMMARY AND CONCLUSIONS 


The interpretation of many studies dealing with the relative. 


scholastic achievement of veterans and non-veterans is limited 
because such factors as age and scholastic aptitude have not been 
adequately controlled or because tests of the significance of 
obtained differences have not been made. In general, it appears 
that the academic achievements of veterans were slightly es 
to those of non-veterans.^9!5 Although it was suggested that 
age alone was responsible, this thesis was not supported in fact 
The service experience itself seems to have contributed to the 
better performance of veterans. The wide range of experiences 
travelling, and constantly making adjustments Sir eie had 
their effect in enabling the veteran student to derive › from 
his education than the non-veteran. ae 
The present study includes four hundred fourteen male students 
taking science, social science, or technology courses. The pref- 
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erence of veterans for technological subjects, reported by Tibbets 
and Hunter, shows up in the present study also. This trend 
seems to be a carry-over from the war-time tendency toward these 
fields. 

In all instances, the mean post-service grade-point average for 
veterans was higher than their mean pre-service grade-point 
average. Furthermore, the veterans taking coursesin technology 
exceeded their non-veteran classmates despite a lower mean 
high-school average, and a lower mean score on the Psychological 
Examination. However, veterans taking a science or social 
Science course were not able to equal the consistently high per- 
formance of non-veterans. Factors that may contribute to this 
difference between students taking a technology course and those 
taking either a science or social science course are discussed. 


REFERENCES 


1) “Academic Achievements of Veterans at Cornell University.” 
School and Society, uxv (1947), 101-102. 

2) Edward L. Clark. ‘The Veteran asa College Freshman." School and 
Society, хут (1947), 205-207. 

3) Paul E. Clark, and Bernard A. Staskiewicz. ‘Achievements of 
Veterans in General Chemistry." School and Society, uxv (1947), 482-484. 

4) Stephen E. Epler. “Do Veterans Make Better Grades than Non- 
Veterans?" School and Society, хут (1947), 270. 

5) Norman Garmezy and Jean M. Crose. “A Comparison of the Aca- 
demic Achievement of Matched Groups of Veteran and Non-Veteran Fresh- 
теп at the University of Iowa." Journal of Educational Research, XLI 
(1948), 547-550. 

9) Arthur M. Gowan, ‘Characteristics of Freshmen Veterans." Journal 
of Higher Education, xx (1949), 205-206. 

7) M. G. Orr. “Grade-point Averages of Veterans at Oklahoma Agri- 
Cultural and Mechanical College." School and Society, uxvr (1947), 94. 

8) Frederick D. Pultz. “Veterans in the Ohio State University College of 
Education.” Educational Research Bulletin, xxv1 (1947), 153-150. 

9) G. W. Read. ‘Scholastic Achievement of Veterans." (Abstract) 
American Psychologist, т (1946), 452. 

10) Svend Riemer. ‘Married Veterans are Good Students." Marriage 
and Family Living, 1x (1947), 11-12. 

11) Robert H. Schaffer. “А Note on the Alleged Scholastic Superiority of 
Veterans.” School and Society, хуп. (1948), 205. 

12) William B. Schrader and Norman Frederiksen. “The Comparative 
Achievement of Veteran and Non-Veteran Students in College." (Abstract) 
American Psychologist, xix (1948), 259. 


42 The Journal of Educational Psychology 


13) Edgar A. Taylor. “Ноу Well Are Veterans Doing?” School and 
Society, uxv (1947), 210-211. 

14) Clark Tibbets and Woodrow W. Hunter. “Veterans and Non- 
Veterans at the University of Michigan." School and Society, xxv (1947), 
347-350. 

15) Ruth С. Weintraub and Ruth E. Salley. ‘‘Hunter College Reports 
on Its Veterans." School and Society, охуп (1948), 59-63. 

16) Ernest L. Welborn. “The Scholarship of Veterans Attending а 
Teachers College." Journal of Educational Research, xu (1946), 209-214. 


READABILITY OF CHILDREN’S TEXTBOOKS* 


EDMUND W. J. FAISON 
George Washington University 


The purpose of the present study is to compare the readability 
of the texts currently used in the fifth, sixth, seventh, and eighth 
grades of two school systems by application of the Flesch read- 
ability formulas. 

In 1948, Flesch? reported a revision of his readability formula. 
This readability yardstick has two indices: 1) the measure of 
‘Reading Ease,’ and 2) the measure of ‘Human Interest’ (here- 
after referred to as RE and HI, respectively). The RE formula 
Involves the average sentence length in words and the average 
word length in sentences. The elements of the HI formula 
are the average percentages of ‘personal words’ and the average 
percentage of ‘personal sentences.’ Flesch developed this 
formula only after careful analysis of all of the previous attempts 
to measure readability, and it is by far the most objective and the 
easiest to apply of all readability measures. 

The application of this formula to children’s textbooks is 
appropriate. The scale offers educators a means of objectively 
placing texts on a scale of comprehensibility; and it will also 
Point up to the authors of these texts the parts which need 
special attention when they are writing for a particular level. 
With this scale as a criterion the proper grade-placement of 
certain books and of certain types of material can be determined. 
In this respect, Ayer! found that, due to use of figurative language 
and abstract words and concepts, pupils with normal seventh- 
grade reading ability could answer only thirty-one per cent of the 
questions based on original fifth-grade histories used throughout 
the country. 

SAMPLING AND PROCEDURE 


. The books of two city school systems in the vicinity of Wash- 
ington, D.C. were used in this study. In the schools of City A 
there are no assigned books for each grade. The teacher is 
Permitted to select whatever books he wants to use. Therefore, 
ees 

_ * This is an abstract of an M.A. thesis done at George Washington Univer- 
Sity. The author gratefully acknowledges the assistance of Dr. E. Lakin 
Phillips who helped direct the study. 
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every class may use different texts. A teacher may use one 
basic text and have several other texts for supplemental reading. 
This made the problem of sampling difficult. The books selected 
were the ones which the bookroom clerk estimated were called for 
more often than the others. In some cases, this made it possi- 
ble to use the books of a specific series in this study. 

In City B, standard texts were used in every grade. The texts 
used in this study were obtained from one elementary school for 
the fifth- and sixth-grade books, and from a junior high school for 
the seventh- and eighth-grade books in both cities. 

The fifth grade was selected as the lowest grade for the study, 
inasmuch as Flesch devised his formulas with the top value of 
100 representing the score of books suitable for one who has com- 
pleted the fourth grade (one who is barely functionally literate 
in terms of the United States Department of Census). 

The sampling of the sixth grade was made in order to ascertain 
what changes in reading ease and human interest take place in 
books used in the elementary schools. Books used in the seventh 
grade were sampled in order to learn what changes take place in 
reading ease and human interest in the jump from elementary 
schools to junior high schools; and the eighth grade, in order to 
determine if a greater difference in human interest and reading 
ease takes place in junior high school than it does in elementary 
schools. 

PROCEDURE IN RATING BOOKS 


The formulas for rating RE and HI are as follows: RE = 
206.835 — .846 wl — 1.015 sl (where wl equals the average 
word length in syllables per 100 words and sl equals the average 
sentence length in words). HI = 3.365pw + .314ps (where pw 
equals the average per cent of personal words and ps equals the 
average per cent of personal sentences). 

A score of 100 with the RE formula corresponds to the predic- 
tion that a child who has completed the fourth grade will be able 
to answer correctly three-fourths of the test questions to be asked 
about the passage that is being rated. An HI score of 100 indi- 
cates that the passage has enough human interest to suit the 
reading habits and skills of one who has completed the fourth 
grade.? 

A total of thirty-eight books were rated. One book was 
selected for each school subject from each grade for each school 
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system. Thirty samples of one hundred words each were selected 
on a strictly numerical basis from each book. Each sample 
Started at the beginning of a paragraph. The number of sylla- 
bles, number of sentences, number of personal words, and the 
number of personal sentences per each one hundred words were 
counted. . 

The exact procedure recommended by Flesch was used in all 
cases with the exception of the mathematics texts. It was con- 
Sidered advisable to apply a special procedure to them so that a 
comparison could be made with the other texts. 

A large portion of all mathematical books consisted of addition 
9r subtraction problems such as: 


2735 
4624 
3552 


+6189 


It was felt that these numbers had to be considered and could not 
© skipped over as Flesch recommends. Also, if each horizontal 
Tow was considered as one four-place number, a large number of 
Syllables (and consequent increase in difficulty) would occur which 
Apparently is not the case. In this study, an addition or sub- 
traction problem which had to be completed by the reader was 
Computed on the following basis: Every individual number 
instead of every horizontal row was counted as a word. This 
Procedure was followed because every student reading these 
Problems would read each vertical column one number at a time, 
ashe actually performs the addition. Each problem was counted 
АЗ à sentence since it represented a complete unit. This is a 
Somewhat arbitrary procedure, but it appeared to be the most 
"fensible one under the circumstances. 
In counting personal words all personal pronouns and nouns of 
à masculine or feminine gender were included. The group words 
zi S' and ‘people’ (with a plural verb) were also counted. 
ersonal sentences were those which were spoken as indicated by 
Quotation marks or otherwise; questions, commands, requests, 
ete, directly addressed to the reader; exclamations; and gram- 
Matically incomplete sentences whose full meaning had to be 
inferred from the context. 
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RESULTS 


In comparing school systems, (Table I) the texts of the two 
school systems revealed few large differences in ease of reading. 
The books from both systems showed a progressive decrease in 
reading ease from the fifth through the eighth grades, with the 
smallest difference between the seventh and eighth grades. 


TABLE I.—Mzax Scores or READING EASE AND Human INTER- 
EST OF ALL Texts IN City A AND Crry B, Grapes Five 


THROUGH Eranr 
ee шшш = 


City A City B 
Grade 
RE Score | HI Score | RE Score | HI Score 
5th 78.5 29.8 76.0 31.0 
6th 71.5 27.0 74.8 34.0 
7th 68.6 39.0 69.8 35.3 
8th 68.6 32.3 68.8 33.6 
Mean 71.8 32.0 172.7 33.4 
== СЕ MI E E NET ee GENE RENT 


'The reading ease scores are in the upper bracket of the range 
Flesch reports as ‘fairly easy’ in the fifth grade and steadily drop 
to the upper portion of what Flesch calls the ‘standard’ range in 
the seventh and eighth grades. 

Examination of the table shows that the HI scores of books of 
each school system reveal different patterns. These patterns, 
however, are difficult to analyze. Flesch defines a score of HI 
100 as the score which a book must obtain if it is to hold the 
interest of a person with a fourth-grade education. This has 
been interpreted to mean that as a person becomes better edu- 
cated, the reading material can gradually decrease in human 
interest and still hold the reader’s attention. 

All of the mean human interest scores for each grade are within 
the category which Flesch calls ‘interesting.’ The range of the 
scores is not great, but the patterns within the range are of inter- 
est. In City B, the fifth-grade texts were the least interesting. 
A gradual increase in human interest occurred up to the eighth 
grade, where it dropped to a level slightly below that of the sixth 
grade. Although the differences are small, they show a trend. 
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In City A, the sixth-grade texts were less interesting than those 
of the eighth grade. But the textbooks of the junior high school 
(seventh and eighth grades) were more interesting than those of 
the elementary school. 

With the exeeption of the seventh-grade score, the schools of 
City B used more interesting texts on the whole. The high 
Seventh-grade human interest score (City A) was due to the very 
large increases in HI in science and literature from the sixth to 
the seventh grade. 


ANALYSIS OF RESULTS BY GRADES 


Results by grades are given in Table IT. Although the average 
Teading case scores dropped consistently, many discrepancies 


TABLE IL—ConxranrsoN or Mean READING EASE AND HUMAN 
INTEREST Scores or tre Texts or Five Sussecrs Tavamr 
IN Two SCHOOL SYSTEMS FROM THE FIFTH vo THE EIGHTH 
GRADES INCLUSIVELY 


5th 6th 7th Sth 
Subject Loca- ——— 
tion 5а 

RE|HI|RE|HI|RE| HI | RE| HI 

English City A 75 | 50 | 70 | 34 
City В | 76 | 33 | 77 | 45 | 77 | 52 | 83 | 57 

History City А | 85 | 51 | 71 | 29 | 68 | 34 | 60 | 23 
City B| 81 | 29 | 75 | 21 | 68 | 22 | 60 | 18 

Math. City А | 71 | зо | 69 | 26 | 55 | 19 | 58 | 19 
City B | 69 | 21 | 78 | зо | 58 | 34 | 62 | 20 

Reading or tt | City A | 79*| 29*| 74 | 39 | 74 | 55 | 80 | 57 
Bor Lit. y B| s6 | ат | S1| 57 | 74 | 42 | 72 | 43 
Science City A | 79 | 09 | 72 | 14 | 74 | 37 | 75 | 28 
City В | 68*| 25+] 63 | 17 | 72 | 26 | 67 | 30 


* 


Sixth City A, Social Studies is taught instead of Reading in the fifth and 
th grades. In City B, Geography is taught rather than Science in the 
and sixth grades. These subjects are listed for comparison. 


Occurred among the individual subjects. In City B, English 
ecame easier to read as the grade increased. This result was 

fea mainly by the larger number of syllables in the lower 
Soks, 


s 


48 The Journal of Educational Psychology 


In both cities the reading ease of mathematics increased from 
the seventh to the eighth grades. This increase was due to the 
change in style of arithmetic problems. Instead of listing 
columns of problems to be added or subtracted, the eighth grade 
books more often expressed the problems in a realistic fashion 
with the result that a little story was told about every problem 
situation and the effect of the actual numbers was minimized 
in figuring reading ease. 

This result was achieved primarily because of the difference in 
the subject matter taught. In the seventh grade common frac- 
tions, decimal fractions, integers, measurement, and percentages 
are the primary topics considered. In the eighth grade, banking, 
insurance, taxes, geometry, investments, and mensuration are 
taught. It can readily be seen that the topics in the eighth 
grade cannot have problems which are expressed in rows with 
instructions to perform the necessary operations. 

There are other inconsistencies which cannot be explained on 
any basis other than the style of the authors. The largest 
drop in reading ease occurred in mathematics between the sixth 
and seventh grades. Here the child takes only arithmetic in the 
elementary school, but when he begins junior high school he is 
confronted with the much broader and more difficult subject 
of mathematics which includes all of the topics already mentioned. 
This increase in difficulty of the subject is reflected in the reading 
ease score. 

It would seem that the factor of human interest has been 
practically ignored by the writers of all texts with the exception 
of the subject of mathematics. As is expressed in the preface of 
many of the mathematics books, there has been a conscious effort 
to state as many exercises as feasible in problem situations rather 
than just problems. These authors have realized that real 
learning takes place more rapidly when the child is projected into 
the problem situation. It is a real tribute to these authors that 
they have made their subject matter more interesting than science 
or history in some cases. 

Only the fifth grade science text of City A fell into the ‘dull’ 
category. It included few personal sentences or words. i 


ANALYSIS OF RESULTS BY SCHOOL SUBJECTS 


The over-all trends are shown in Table III. It can be seen 
from this table that the most difficult subject was mathematics. 


4 


LS 
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The average difficulty for all four grades was higher than the 
average eighth-grade score for all subjects. 


TABLE IIL.—CowranrsoN or THE MEAN READING EASE Scores 
AND MEAN Human Interest Scores or THE Texts or FIVE 
SUBJECTS FROM THE FIFTH THROUGH THE Ёпбнтн 
GRADES or THE Crry A anp Crry B Scuoon 
SYSTEMS 


Math Science History English Literature 


City A 
RE 63.25 75.0 71.0 71.0 76.75 
HI 23.25 22.0 34.95 42.0 45.50 
City B 
RE 66.75 67.50 71.0 78.25 78.25 
HI 26.25 24.50 22.25 49.25 47.25 
Mean Score 
RE 65.0 71.25. 71,0 74.63 77.50 
HI 24.75 23.25 28.25 45.63 46.37 


The procedure in rating mathematics books was different from 
that used for the others. The modification of the method recom- 
mended by Flesch was incorporated to increase the reading ease 
Scores so that they could more readily be compared with the 
Scores of the other texts. If the procedure Flesch recommends 
had been applied to the mathematics books, the scores would have 

ееп even lower on the reading ease scale. With either procedure, 
however, mathematics would still be considered the most difficult 
Subject when using the reading ease score as a criterion. 

History, with a reading ease mean score of 71.0, was the second 
Most difficult subject. This score according to Flesch’s norms 
Would be on the border between ‘standard’ and ‘fairly easy.’ 

The history average was the same in both cities, but in City B, 

istory was the third most difficult subject to read, with science 
Preceding it; whereas in City A, history and English were tied for 
Second and third (2.5) place in the rank order scale of difficulty. 

Science books had an over-all mean of 71.25. This merits 
third place on the scale, but the difference of .25 between this 
Score and the mean history score is too small to be considered 
Significant. 

In City B, science ranked second, while in City A, it ranked 
fourth in the order of reading difficulty. 


A 
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In the fifth and sixth grades in City B, geography is taught 
in place of science, and in this study geography was considered 
with the science group. 

English was the fourth of the five subjects on the composite 
mean rating scale. There was, however, a marked difference 
between the two school systems. English was tied for the second 
and third positions (actually position 2.5) with history in City 
A; and tied with literature for the fourth and fifth places (actually 
4.5) in City B. 

Literature was found to be the easiest subject with an average 
reading ease score of 77.5. This over-all average is at the mean 
of all the subjects of the fifth grade. 

Literature, as such, is not taught in the elementary schools. 
In City B, fifth- and sixth-grade readers are used. These readers 
contain light stories about the activities and accomplishments of 
children. In City A, the elementary schools have books which 
are entitled ‘Social Studies.’ These books are used as readers, 
but they contain stories which are more directly related to educa- 
tional topics. It is not surprising, therefore, to find that the 
City B elementary schools have higher reading ease scores for 
their readers than in City A. 

Mean human interest scores are also given in Table III. The 
mathematics textbooks had a human interest value of 24.75. On 
the rank-order scale which begins with the least interesting sub- 
ject, mathematics texts ranked second with a value 1.5 points 
higher than science. 

In City A, the human interest score of mathematics ranks 
exactly as it does in the composite mean. In City B, mathe- 
matics is third, falling behind history and science. 

History ranked third on the composite human interest scale 
with the score of 28.25. This agreed with the result obtained in 
City A; but in City B, history was the dullest subject in terms of 
human interest. This result was caused by the long sentences 
and few personal references. 

Science was the dullest subject in the composite scale in City A- 
This result was due mainly to the lack of personal words. It is 
very difficult to be personal about scientific facts unless an 
experiment is described by the worker who performed it. In 
City B, science was second with history preceding it by 2.25 

points. 
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In City A, literature was slightly higher than English, and 
was, therefore, fifth in that series and in the composite scale. 
But in City B, literature was slightly lower than English, but not 
enough to reverse the positions on the composite scale. The 
averages of both subjects fall in the group Flesch calls ‘highly 
interesting.’ These two subjects are nearly 20 points higher than 
the other subjects in human interest. 


SUMMARY 


All books rated for reading ease fell within the range of Flesch’s 
Categories ‘fairly difficult’ to ‘easy.’ The norms of each grade 
for both school systems showed a consistent decrease with the 
Scores gradually leveling out between the seventh and eighth 
grades. The subjects were ranked in order of difficulty (reading 
ease score) and the following results were obtained: Mathematics 
(most difficult), history, science, English, literature (easiest). 

The mathematics average for all four grades was lower than 
the average of all subjects of the eighth grade. The literature 
average for all grades was approximately that of the average of 
all of the subjects of the fifth grade. 

No definite pattern was shown in human interest scores. All 
of the averages for the individual grades were in the ‘interesting’ 
Tange, however. The mathematics texts were the only ones in 
which a conscious attempt had been made by the author to 
Personalize the material presented, but even there no system 
Seemed to stand out. 
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SELECTION OF STUDENTS FOR A TRADE AND 
INDUSTRIAL EDUCATION CURRICULUM 


H. S. BELMAN AND R. N. EVANS 
Purdue University 


Numerous articles by educators have appeared, suggesting that 
it would be desirable to select students for teacher training in 
industrial education, rather than to accept all those who apply. 
However, few concrete proposals or examples have been presented. 

In 1942, Pawelek found that “іп eighty-two per cent of the 
industrial arts departments, any student admitted to the uni- 
versity is automatically admitted to the department." When 
one hundred leading educators in the industrial arts field were 
polled, however, more than ninety-five per cent of them favored 
setting up definite admission standards.? 

Land has been one of the few leaders in the field of industrial 
education who has reported on a comprehensive, objective 
method of selection. He states that prospective teachers of 
vocational industrial subjects at Pennsylvania State College are 
given a battery of tests which include “a four-hour trade per- 
formance test administered by a competent examiner, a three- 
hour trade theory examination, a psychological examination, an 
English test, and an interview by a competent committee of 
three.” This selection procedure is based upon a definite philoso- 
phy which might well be adopted elsewhere, for Land goes on to 
say: "The teacher-training institution which merely conducts 
courses for the preparation of teachers, without regard to their 
adequate selection and placement . . . is not meeting its responsi- 
bility.”* However, concrete programs of this or any other type 
are the exception at present, and even Land makes no reference 
to studies of the validity and optimum weighting of these 
predictors. 

Traditionally, the selection of candidates for industrial teacher 
training has been done on the basis of physical appearance, 
method of shaking hands, anda perusal of assorted grades, tests, 
and recommendations. Little objective study has been devoted 
to the relevance of such predictors of success. The fact that 9 
sizeable portion of the men selected in this fashion have been 
successful is an indication that it has produced some good results, 
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but as competition increases in the field of industrial education, 
any method of selection which does not yield perfect results 
should be examined periodically. 


STATEMENT OF THE PROBLEM 


The Trade and Industrial Education curriculum, Division of 
Education and Applied Psychology, Purdue University, prepares 
Students for one of three types of employment: 


1) Teaching industrial education subjects in the public sec- 
ondary schools. (a) vocational industrial. (b) indus- 
trial arts. 

2) Training within industry. 

3) School building service (superintendents of buildings and 
grounds). 


Students enter this curriculum from two principal sources: 
approximately thirty per cent enter the curriculum as freshmen, 
and approximately seventy per cent transfer from other schools 
of the University. This study is concerned with the selection of 
the latter group from among those who apply. 

The transfer problem in any large university is a troublesome 
Опе. Many students enroll, for example, in engineering, believ- 
ang that it involves primarily manipulative work. They often 
Persevere in the school of their original choice for three or four 
Semesters, becoming progressively more maladjusted, unhappy, 
and earning progressively poorer scholastic records. Other stu- 
dents with no particular aptitude for college work also have 
difficulties with their present programs. Both types are among 
the applicants for transfer to trade and industrial education. 

bviously, it is to the best interest of both the student and the 
School, that only those with aptitude for teaching in trade and 
Industrial education be selected. 


DESIGN OF THE EXPERIMENT 


The present research is based upon an unpublished study by 
tal W. Porter and R. N. Evans‘ in which records of eight tests 
aken by twenty-seven graduates of the Trade and Industrial 
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Education curriculum at Purdue were studied. Using the 
criterion of grade point index after transfer to the Trade and 
Industrial Education curriculum, the best individual predictor of 
the eight studied yielded a correlation of .67 with the criterion. 
This study indicated that students could be selected more effec- 
tively than had been possible in the past. 

The next problem was to secure more representative data 
covering a larger number of predictors. With this in mind, 
arrangements were made to administer a test battery made up of 
sixteen separate predictors to all World War II veterans and 
twenty-five per cent of the non-veterans in the T. & I. E. cur- 
riculum.* Participation in the testing program was voluntary, 
but ninety per cent of the eligible students took the entire battery 
of tests upon which these results are based. Ten additional 
predictors were obtained from orientation test scores and from 
student records, making a possible total of twenty-six test scores 


and other pertinent facts for each of the one hundred seven 
students who participated. 


MEASUREMENT TECHNIQUES AND RESULTS 


As in the previous study, the criterion of grade point index 
after transfer was correlated with each of the predictors, yielding 
the results shown in Table I. A measure of statistical signifi- 
cance was applied? and all of the predictors which proved to be 
significantly non-zero at the one per cent level were selected for 
inclusion in a Wherry-Doolittle test selection problem.** This 
procedure provides a means by which tests are selected from a 
battery in the order in which they contribute to the prediction 
of the criterion, and at the same time eliminates tests which 
contribute nothing new to this prediction. A further result of 
this procedure is the determination of the optimum weighting for 
each test selected. 

For students who have been allowed to enroll in Trade and 
Industrial Education courses on a one-semester trial basis, the 
prediction sheet shown in Table II is used as a basis for deciding 


* These tests were administered and Scored by the staff of the Veterans' 
Guidance Center at Purdue. The cost of testing non-veterans is borne by 
the University. 
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TABLE I.—Srupyinc TRANSFER STUDENTS IN TRADE 


AND INDUSTRIAL EDUCATION 


Index after Transfer = Criterion 


Predictors 
Kuder Mechanical Interest 
Kuder Computational 
Kuder Scientific 
Kuder Persuasive 
Kuder Artistic 
Kuder Literary 
Kuder Musical 
Kuder Social Service 
Kuder Clerical 
Guilford-Martin O 
Guilford-Martin Ag 
Guilford-Martin Co 
How Supervise 
How I Teach 
Purdue Mechanical Adaptability 
Purdue Adaptability 
American Council on Education Psych. 
Purdue English 
Purdue Mathematics 
Purdue Physical Science 
Index before transfer 
Grade in Introductory Course to Trade and 
Industria] Education 
Teviously dropped from University—yes or no 
ailed or passed Engineering Drawing 
eteran or non-veteran 
efinitely chose option—yes or no 


Correlation 

with 

Criterion 
.0335 

— .0056 
.0437 
.0128 
.0529 
.0364 
.1309 
.1670 
.0059 
.0109 
.1482 
.1659 
.2893* 
.9154* 
.1875 
.4120* 
.2631 
.2995* 
.9441* 
.2621 
.4982* 


.5381* 
. 2678 
.4368* 
.0806 
.4347* 


umber for which every predictor was available = 83 


* : 
Indicates one per cent level of confidence that г is non-zero. 
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whether or not they should continue. The predictors shown in 
the table are not adequate for the majority of transfer students, 
however, since they do not have the opportunity to enroll in 
Education 30 (Introduction to Trade and Industrial Education) 
before transferring. For this reason, the statistical computation 
was done a second time, omitting this predictor, which produced 
slightly different results. The multiple correlation coefficient for 
the predictors shown in Table II was 748, while the multiple 
correlation coefficient for the second method, which did not 
include the one predictor, was .731. 

It should be noted that these correlation coefficients, while far 
from perfect, are considerably higher than most of those obtained 
with test batteries now widely used in predicting success in 
industry, and in colleges, universities, and high schools. How- 
ever, at least a temporary upper limit has been approached, and 
it is unlikely that correlations much higher than about .75 will 
be obtained, until some method of increasing the reliability of 
grades has been devised and put into effect. 


TABLE II.—Prepicrion SHEET ron Use WITH UNCLASSIFIED 


STUDENTS s 

Grade in Education 30 X .2025 = .  —— 
Index Before Transfer с X.3258— . — 
Score on Purdue Adaptability х .0029 = . .— 

(per centile, Purdue Seniors) 
Score on How Supervise, Form M 

(per centile, Level II Supervisors) x.00200— . /-. 
Score on English Orientation à 

Test (per centile, Purdue Freshmen) x .0026 = . /- 
If This Student Has Definitely 

Chosen an Option, add +.3200 X . 


14270. 
Plus 1.4270; 
Equals Expected Grade Point 

Average After "Transfer M S 

As another way of Showing the results obtained, Figure 1 has 
been prepared. The limit lines have no statistical significance, 
but are merely plus or minus one-half grade point, and show that 
if, for example, it is predicted that a student will make a 4.0 grade 
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PREDICTION OF SUCCESS 
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PURDUE UNIVERSITY 


2.6 28 +0 +2 44 46 28 
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index, it is quite unlikely that he will actually make below 3.5 
or above 4.5. 

The prediction methods described above are now in use in the 
Trade and Industrial Education curriculum at Purdue, but the 
process of further development of these selection techniques is 
still going on. New transfer students and the remainder of the 
non-veterans in the school are now taking a different battery of 
tests. The results achieved will be correlated at a later date 
with the grade point indices obtained by these students, and the 
whole selection procedure overhauled in the light of this new 
data. It is felt that only through a continuing process of 
experimentation can optimum results be obtained. 


CONCLUSIONS 


1) The scholastic success of students entering a teacher- 
training curriculum in industrial education can be predicted with 
a reasonable degree of accuracy when correct techniques are used. 

2) Such predictions can be used with considerable assurance in 
counselling students; and, when institutional policies permit, 
these predictions can form a very important part of the student 
screening and selection procedure. 
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BOOK REVIEWS 


Marruew №. CHAPPELL. In the Name of Common Sense: Worry 
and Its Control. New York: The Macmillan Company, 
1949, pp. 172. $2.75. 


The title of this book, In the Name of Common Sense, bears 
little relationship to the actual content; the sub-title, Worry and 
Iis Control, indicates more accurately the nature of the material 
presented. . 

The author seems not to have made up his mind whether he is 
Writing for professional or lay readers. For example, it is diffi- 
cult to see what the average person would make out of the fol- 
lowing quotation: “Life, Pike states, is a function of four variable 
factors: (E), the environment; (PC), the physicochemical con- 
ditions of the body; (G), the glandular system; and (N), the 
nervous system. Mathematically, Pike's formula is stated as 
follows: 

L = Ј((Е)(РС)(@)(А))”" 


On the other hand, such passages as the following hardly appeal 
to the psychologist or the psychiatrist: ‘The word ‘neurotic’ is 
а relic of a mistake made two or three hundred years ago. So 
are its cousins, ‘hysteria,’ ‘neurasthenia,’ and 'psychasthenia.' 
They are all mistakes of past centuries. Now they are nearly 
Meaningless. They all mean the same thing: that one has 
developed outstanding skill in making himself emotional and in 
Maintaining that skill. Anyone who tries to make them mean 
More is talking through his hat."? 

The book is confusing at many points. Chappell rightly con- 
demns the concept of will power, yet his recommendations for the 
Control of worry sound surprisingly like the admonition to use 
will power and stop worrying. He urges his reader not to talk 
about his difficulties, asking him to make a resolution that he 
Will discuss his troubles with no one except his physician. This 
Point of view is not in keeping with modern therapeutic methods. 

t is rather generally accepted that catharsis is the first step п 
Psychotherapy. One gets the impression from reading pec 
à i eu iti in 
200k that worriers should begin with positive action 
1р. 163. 
* pp. 87-88. 
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ending with it. There is little understanding here of the dynamics 
of anxiety. Insight is referred to but not emphasized. 

This reviewer sees but little in this book to recommend it. 
It is too technical for the layman and too superficial and opinion- 
ated for the professional reader. Moreover the point of view 
presented is frequently at variance with well established princi- 
ples of psychotherapy. HERBERT A. CARROLL 

University of New Hampshire 


A. ANASTASI AND J. P. Forey, Jm. Differential Psychology. 
Revised Edition. New York: The Macmillan Co., 1949, 
pp. 894. 


This book is thoroughly revised and greatly enlarged. The 
revised edition is larger by two hundred seventy-four pages, and 
each page contains about one-fourth more words than the original 
edition. Whereas the first edition makes use of five hundred 
sixty end-of-chapter references, the revised edition presents nearly 
fifteen hundred. The revised edition contains four additional 
chapters, the material of which is largely new. These are “Basic 
Concepts of Psychological Testing," “Biological Factors in 
Simple Behavior Development,” ‘Psychological Factors in 
Simple Behavior Development," and “Schooling and Intelli- 
gence.” Practically all the other chapters are expanded—some- 
times by the addition of new sections and sometimes by a com- 
plete rewriting. 

Style, purpose and general method of treatment of data as 
found in the original edition are largely preserved. There is the 
same or perhaps slightly greater emphasis upon methodological 
problems and interpretation. Certainly both editions amount to 
source books in their field, but much of their significance lies in 
the fact that they present the student with a coherent, significant 
and meaningful account of the data. As such, the revised edi- 
tion, like the first, should make a useful textbook. It should fill 


the needs of collateral reading for several courses in psychology: . 


It is a significant contribution. J. B. STROUD 
State University of Iowa 


JEAN PIAGET AND BÄRBEL INHELDER. Le Développement des 
Quantités chez l'Enfant. Conservation et Atomisme. Paris, 
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Те, rue de Grenelle: Editions Delachaux & Niestlé S. A., 
pp. 344. 


The specific processes of maturation and of learning through 
which children’s early understandings are formed constitute a 
subject of great interest to psychologists and teachers. Cer- 
tainly, all too little is known in this area at present. Piaget and 
his collaborator contribute here a significant report of research 
in the formation of quantitative concepts by children, with three 
principal problems involving experimental induction as the cen- 
ters of attention. 

The first problem attacked by Piaget and Inhelder is this: By 
What sequential development and at what age may ideas of the 
permanence of substance, of weight and of volume become under- 
stood by children? The technique used was as follows: The child 
was given a little ball of clay and was directed to make another 
just like it, “the same size and the same weight." Then one of 
the balls was altered in shape, either by lengthening it to the 
form of a sausage, or by flattening it like a pancake, or by some 
other method. Thereupon, the child was asked whether the two 
balls still had. the same weight, the same quantity of material, 
and the same volume. He was also urged to explain his answers. 

Four important stages were observed in the successive appear- 
ance of concepts inherent in this first problem: 

1) Before the age of seven or eight, the child understands 
neither the permanence of the substance, nor of the weight, nor 
of the volume of the deformed ball of clay. 

2) At the approximate age of eight to ten, the child compre- 
hends that the ball is of the same substance, but not that it has 
the same weight and volume as before. 

3) From ten to eleven or twelve, he understands that it is of 
the same substance and weight, but not yet that it has the same 
volume. 

4) Beginning with age eleven or twelve, the child is able to 
‘recognize simultaneously the three forms of permanence of the 
deformed ball of clay, with a tendency to reduce the idea of sub- 
Stance to those of weight and of volume. 

The second aspect of this research also concerns itself with 
children’s ideas regarding the permanence of substance, and, 
more specifically, with what becomes of sugar when it is dissolved 
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in water. Piaget and Inhelder, working with more than one 
hundred children from four to twelve, found indications of the 
same stages in development of understandings as those observed 
in the experiment with the small balls of clay. At first, the child 
believes that the substance of the sugar, when dissolved, dimin- 
ishes to nothing. Later, he understands that the substance is 
maintained, but thinks that the sugar's weight and volume are 
lost. Then he adds the idea of the invariability of weight and, 
finally, of the invariability of volume. 

A third area of experimentation reported in this volume is 
related to children's concepts of the nature of substance. Such 
materials as a cork, a pebble (smaller but heavier than the cork), 
and a piece of wood (of a size intermediate between the two, 
heavier than the cork, but lighter than the pebble) were pre- 
sented to the children and made the subjects of questioning. 
Four stages of conceptual growth are recorded, indicating progress 
from the belief that a body is heavy in proportion to its size, to an 
understanding of density, dilation and contraction. 

The four stages of development which the investigators found 
in each of these experiments may seem to the reader to be а 
rather too highly systematized ‘means of reporting the findings. 
The important conclusions, perhaps, are contained in the observa- 
tion of a consistent sequential development of the concepts, with a 
similar pattern in each experiment. Such conclusions may have 
valuable implications in terms of curriculum planning and the 
direction of learning activities in the elementary school. 

Any experimental work is commendable which adds to our 
knowledge of how children change through maturation and 
through perceptual experiences, at what rate and through what 
sequences they arrive at insightful response to the innumerable 
problematic situations where they find themselves. Piaget has, 
in this volume, added notably to his already famous contributions 
in the study of children’s concepts. He and his associate have 


suggested lines of experimentation which may continue to 


increase in important ways our understanding of children. 


Winnis N. POTTER 
College of the Pacific 


Бао, RoseNzwEIG wirH Kare L. Kocan. Psychodiagnosis- 
New York: Grune and Stratton, 1949, pp. 380. 
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As a sequel to F. L. Wells’ Mental Tests and Clinical Practice 
and Murray’s Explorations in Personality, this book explains the 
purpose, materials, obtained data, scoring methods, and interpre- 
tation of a representative group of psychological tests as they 
are employed in up-to-date psychodiagnosis. 

This treatment, addressed to beginning students of professional 
psychology and those in the allied fields of medicine, nursing, 
Social work, ete., is in untechnical language; it excludes standard- 
lzation procedures and gives little emphasis to theoretical 
Considerations. 

A brief discussion of clinical psychology as a diagnostic art is 
followed by several chapters dealing with tests of general intelli- 
Бепсе, measures of intellectual deviation, tests of vocational apti- 
tude and interest, and projective techniques. The process of 
Psychodiagnostic integration is presented in terms of concrete 
case history examples, illustrating clinical procedure in the 
Synthesis of information obtained from the separate tests and 
Interviews which results in the emergence of a final picture of the 
Personality. 

А In a retrospective and projected consideration of psycho- 
diagnosis as a science, the author traces the development of the 
theories of the academic psychologist and the practices of the 
clinica] psychologist as relatively independent movements. A 
Shift in the center of gravity in psychology from emphasis on the 
generalized average man to the structure and organization of the 
Individual person is recommended as a common effort in which 
the academic and clinical psychologist can unite for scientific 
advance, 

This explicative but untechnical presentation of psychodiag- 
nostic procedures supplies an important link in the development 
ога Closer liaison between clinical psychologists and professionals 
2 allied fields. The effectiveness of this book as a text book for 

gmning students in clinical psychology is fortified by the 
еш presentation of the subject and the interesting and 

Ustrative case material. 

he section on vocational testing is a little disappointing. As 
© author recognizes, the selection of tests is circumscribed and 
» x equently not very representative; furthermore,-the reader is 
chi With the impression that vocational recommendations emerge 

ely, if not solely, from the test results. At least a brief 
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mention of client-centered vocational counseling as something 

more than test administration and interpretation would have 

been helpful. WirLiAM Е. HOLMES 
The Psychological Corporation 


Loraine А. Dan. Public School Audiometry. Danville, Il.: 
The Interstate Printers and Publishers, 1949, pp. 290. 


Up to the present the measurement of hearing status among 
school children has not received the attention nor the support 
that it deserves. This is partly due to inconsistent techniques 
and standards in the various surveys and the programs for con- 
servation of hearing. Nevertheless, it is well established that 
there are a large number of children of school age who have seri- 
ous hearing impairments. For purposes of medical care, and 
for aid in educational and personality adjustment, it is important 
that these children be identified. The material in the present 
book should both promote and facilitate more adequate measure- 
ment of hearing status. 

This book is both a text and a field manual. Part I, on factors 
to be considered in a hearing conservation program, deals with 
evidence of the problem, factors hindering the program of hear- 
ing conservation, and socio-economic problems of the hard-of- 
hearing child. 'The next part considers the techniques for 
creating interest in the conservation of hearing. Part III pre- 
sents in complete and clear detail the techniques and principles 
of audiometry for the discrete frequency audiometer and for 
group audiometry. The appendixes include material on supplies, 
testing schedules, and forms of reports. There is an extensive 
bibliography. 

This book presents useful information for all those interested 
in the hearing problems of school children. No school nurse oT 
other person concerned with audiometry can afford to be without 


it. Mites A. TINKER 
University of Minnesota 
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DO ALUMNI AND STUDENTS DIFFER IN THEIR 
ATTITUDES TOWARD INSTRUCTORS? 


A. J. DRUCKER AND H. H. REMMERS* 
Purdue University 


Among early comments concerning the rating of instructors by 
Students was the criticism that “student judgment may be unripe 
and different from later judgment. . . "5 Since the time that 
Statement and others like it were made, the influence of maturity 
Within undergraduate groups upon ratings of instructors, using 
the Purdue Rating Scale for Instructors, has been investigated. 
Comparisons of the ratings of freshmen, sophomores, juniors and 
Seniors showed slight differences in ratings of some of the traits, 
but these were "relatively unimportant as compared with the 
resemblances among the four classes,’’> 

. The current investigation was undertaken to test the hypothe- 
Sis that students’ ideas of what constitutes a good instructor 
change as the students grow older, by comparing student and 
alumni judgments of the same traits and instructors. The 
Purpose of the Purdue Rating Scale for Instructors is to measure 
the student/s current judgments, or prejudices, as an important 
spect of the teacher-student relationship, important as a vital 
actor in determining the learning process. It has been stipu- 
lated that the teacher who uses this scale must constantly bear 
m mind that the scale is primarily a device for ascertaining 
Student judgment concerning the traits in question. Regardless 
of what the teacher believes or knows about himself with respect 
to these traits, the student attitude exists, and exists as a func- 
Poning factor in the classroom procedure.’ ies of this 

Vestigati Iter the basic purposes 
з= вацап hence cannot be expected to a. 


* Dr. N. L. Gage gave major assistance in the design of the experiment. 
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or aims of the Purdue Rating Scale for Instructors. If, however, 
it can be shown that students’ judgments of the same instructors 
do not actually change with the years, perhaps more instructors 
will avail themselves of the instrument with increased confidence 
and reliance in the judgments of the undergraduates they teach. 

To test the above hypothesis, two types of comparisons were 
to be made: 1) a comparison of the attitudes of contemporary 
undergraduates toward college instructors with the attitudes of 
alumni of ten or more years’ standing toward the same instruc- 
tors; 2) a comparison of the desiderata of good college instructors 
as conceived by contemporary undergraduates and by alumni of 
ten or more years’ standing. By ‘attitudes toward instructors’ 
we mean ratings by students and alumni of their instructors on 
the Purdue Rating Scale for Instructors. By ‘Instructors’ we 
mean members of the instructional staff for undergraduates at 
Purdue University. By ‘desiderata of good instructors’ we 
mean ratings as to importance for good instruction of a series of 
traits of instructors. 

PROCEDURE 


Since a follow-up study to test our hypothesis was not feasible, 
it was necessary to obtain the judgments of Purdue University 
graduates of the years of 1936 to 1939 and compare them with 
the judgments of current students of the same curricula. . In 
addition it was necessary to use in the study instructors who 
were on the staff in 1936 as well as now, and who are still teaching 
the same courses. The procedure involved in obtaining ratings 
was different in at least two respects from that usually involved 
in obtaining ratings: 1) one to five ratings were to be made on à 
single scale, whereas in the past only a single instructor was 
rated on a scale; 2) the ratings were to be made outside the class- 
room with the permission of the instructors. Since these differ- 
ences in procedure were alike for students and alumni making the 
ratings, they were not expected to have any effect upon any 
comparisons of ratings by students and alumni. The fact that 
classroom time was not being used for making the ratings тау 
have had the effect of obtaining ratings on a more representative 
group of instructors than hitherto has been obtained, since in the 
past only those instructors who both desired the ratings and were 
willing to take class time for them have been rated. 

Selecting Instructors.—A list was made of all instructors appear" 
ing in both the Purdue University Catalogue of 1936 and in the 
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1948-1949 Catalogue. A letter was then sent to each instructor 
stating the purpose of the investigation and asking the participa- 
tion of the instructor whose róle would be purely a passive one— 
that of being rated by alumni and students. Of one hundred 
thirty-nine instructors of whom participation was requested, one 
hundred two consented to being rated. Of the thirty-seven who 
did not give consent, several had no classes of undergraduate 
students for the current year. 

Selecting Alumni and Students.—To maximize the number of 
ratings for the instructors participating in the study, it was 
decided to select alumni and students from schools and depart- 
ments in proportion to the representation of eligible instructors. 
This meant that the students were not selected as strictly repre- 
sentative of the total University student enrollment. It was 
felt, however, that this was not a major consideration. In a 
previous study at Purdue University it was found that student 
ratings were unaffected by a number of investigated factors. 
Freshmen rated their instructors no higher and no lower than 
did seniors, male students rated their instructors no differently 
than did female students, veteran students rated their instruc- 
tors similarly to non-veterans, and students in the upper half of 
the class rated their instructors like those in the lower half. 

At Brooklyn College, in an extensive teacher-rating project 
the evidence indicated that the ratings given to an instructor 
were not affected by the student’s college class, sex or by the fact 
that the course he taught was an elective or prescribed course.’ 

It was decided to send Rating Scales and instructions to five 
hundred students and to five hundred alumni in the proportions 
indicated in Table 1 under per cent of eligible instructors. 
Within schools the sample of students selected was equalized by 
Classes, equal numbers of freshmen, sophomores, juniors and 
Seniors being chosen. For example, in Agriculture, eighteen per 
cent of the total sample of students or ninety students were to be 
chosen. This resolved into twenty-two freshmen, twenty-three 
sophomores, twenty-two juniors and twenty-three seniors from 
the School of Agriculture. In Engineering, since freshmen are 
not designated by Engineering department, the entire quota of 
Engineering students was divided by four to indicate the number 
of freshmen engincers to select. Then the sophomores, juniors 
and seniors were divided according to the quotas of their respec- 
tive engineering schools. 
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TABLE 1.—COMPOSITION OF THE SAMPLE OF STUDENTS BY SCHOOL 
MADE To CONFORM TO THE PER CENT or ELIGIBLE INSTRUCTORS 


Percent Number Рег cent 

Eligible of Approximate 

Instruc- Students University 
School or Department tors Selected Enrollment 


Agricultural Engineering 2 8* 1 
Chemical Engineering 3 15 8 
Civil Engineering 9 34 6 
Electrical Engineering 6 22 13 
Air Transportation, Mechan- 

ical and Aeronautical Engi- 


neering 6 22 24 
Freshman Engineering 34 
Agriculture 18 90 10 
Forestry 2 10 2 
Home Economies 6 30 9 
Pharmacy 4 20 4 
Physical Education 4 12 3 
Science 38 198 18 
Trade & Industrial Education 1 5 2 
Totals 100 500 100 


* Numbers in departmentalized engineering groups are one-fourth less 
because of the allowance for freshman engineers, 


Students were selected for participation at random with the 
help of the current student directory. First the elements of the 
student sample were listed according to class and curriculum. 
Then for a given school and a given class, the total number of 
pages in the directory was divided by the number of students 
in that element. Every Qth page was then designated as a page 
for selecting one student for the given school and the given class. 
The rule was: select the first student whose name appears on that 
page who satisfies the class and school requirement. 

In selecting like alumni for participation in the study, the 
Bulletin of Purdue University for 1936-37 was used, since it listed 
the names of students by class and school enrolled for that year. 
Using the same system of selecting alumni as was used for select- 
ing students, the problem of obtaining the proper number of 
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alumni drop-outs at various stages of their academic careers to 
make the student and alumni samples comparable did not have 
to be met. We simply assumed the students in attendance in 
1936-37 were similar in ability to students in attendance in 
1948-49. The Alumni Association provided addresses for the 
alumni (graduates and non-graduates) we had listed. 

. The Rating Scale and Instructions—The Rating Scales and 
Instructions were mailed to students and alumni alike under the 
Accompanying covering letter. 


PRESIDENT'S OFFICE 
Purdue University 
Lafayette, Indiana 
February 28, 1949 
Dear Alumnus or Student: 


Purdue's standing among educational institutions depends largely on 
the quality of the teaching that goes on in its classrooms and lecture halls. 
here are, however, many unexplored areas of the problem “What makes a 
good teacher?” Attempts to supply an answer have included asking 
Present students to judge their teachers, but such attempts have frequently 
cen attacked on the grounds that the undergraduate student lacks the 
maturity for supplying valid judgments of this sort. It is proposed to 
Investigate this type of criticism more closely with the help of students and 


alumni. 
As students, will your answer to the question “What makes a good 
teacher?” change as you grow older? Or, as alumni, have your ideas as to 
Кы makes a good teacher changed since your student days? These are 
Wo aspects of the question we wish answered. То help us find the answer 
zm Calling upon you to coóperate in an investigation being made by the 
‘vision of Educational Reference. Your task, as explained in the enclo- 
sures, is quire simple and brief. It includes rating your past or present 
©achers at Purdue University. I wish to urge you to complete it thought- 
"ly and at your earliest convenience. м2, 
І should like to assure you that results of the study will never be identi- 
ted with any specific instructor by any member of the instructional staff. 
ме, Tatings will be seen only by one or two confidential clerks. des 
. DES will therefore not affect any instructor's standing. All the teac! ers 
‘Sted on the attached form have individually agreed to participate in the 
vestigation, 
It will be obvious to you, I am sure, that your evaluation of instructors 
Should be entirely your own. It is most important, therefore, that you 
make these evaluations without discussing them with anyone. 


I shall be grateful for your coóperation in this study. 
Sincerely yours, 


Frederick L. Hovde 
President 
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The student or alumnus was first asked to examine the list of 
traits appearing on an enclosed copy of the Purdue Rating Scale 
for Instructors and rank the traits from 1 to 10 as to their 
importance to good college teaching. A brief questionnaire was 
then provided requesting sex, age, year of graduation, total 
number of semesters in attendance at the University, school or 
division, current semester (if a student) and veteran or non- 
veteran status. Next the student or alumnus was asked to 
scan the list of one hundred two instructors’ names and to check 
the names of those from whom he could recall having had courses 
for at least five weeks of a semester. He was instructed how to 
select at random no more than five of those instructors for rating. 
Rating of all five instructors was done in the traditional manner? 
for all ten traits, except that all five ratings were placed on the 
same scale for each trait with the instructor identified by a num- 
ber. The rating scale and questionnaire were then returned by 
mail. 

The Returns.—Of one thousand questionnaires and Rating 
Scales sent to students and alumni, two hundred fifty-one stu- 
dents and one hundred thirty-eight alumni submitted ratings in 
time for the analysis. The students returned a total of eight 
hundred thirty ratings and the alumni a total of five hundred 
seventy-seven ratings. The composition of the student and 
alumni groups which sent in ratings can be seen in Table 2. 

From Table 2 we can surmise that the samples returning rat- 
ings of instructors are fairly similar with regard to sex and school 
or department. Moreover, the proportions of response by both 
students and alumni by schools and departments were approxi- 
mately similar to the proportions in the original mailing. The 
larger number of veterans in the alumni group is to be expected, 
as are, of course, the differences in age. "The most striking differ- 
ence between students and alumni returning ratings, however, is 
found in the number of semesters completed. It will be recalled 
that alumni were selected from a listing (student directory of 
thirteen years ago) including names of those who would fall by 
the wayside, scholastically, or would leave school for other 
reasons. Yet, apparently, almost none of the drop-out alumni 
receiving questionnaires returned them. We must admit, there- 
fore, the possibility that the alumni group may be slightly 
superior academically, notwithstanding the fact that the student 
group is heavily loaded with juniors and seniors. 


EL 
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The number of ratings received for any individual instructor 
by students or by alumni does not exceed fifty. In a few cases 
no students rated a given instructor and in a few more cases no 


TABLE 2.—CHARACTERISTICS OF STUDENTS AND ALUMNI 
RETURNING RATINGS 


Students Alumni 


Males 80% 84% 
Females 20% 16% 
Mean Age 21.8 yrs. 33.0 yrs. 
Age Range 18-31 30-50 
School, Division or Department 

Trade & Industrial Education 1% 2% 

Engineering 22% 28% 

Science 43% 34% 

Pharmacy 5% 5% 

Home Economics 4% 5% 

Agriculture 22% 24% 

Physical Education 3% 2% 
Semester of Work Completed 

1 . 0% 

2 9% 

3 3% 

4 18% 

5 9% 1% 

6 22% 

d 11% 1% 

8 28 % 2% 

Graduated 0% 97% 
Veteran, with Overseas Service Before Sep- 

tember, 1945 26% 38% 


alumni gave a given instructor ratings. Analysis of results to 
make comparisons between ratings of instructors and of traits by 
alumni and students have to be confined to ratings made as а 
whole on all instructors as a group. 


RESULTS 


. Desiderata of Good Instructors.—To compare the relative 
importance to alumni and to students of the ten traits on the 


м 
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Purdue Rating Scale for Instructors, the median rankings of 
each trait by the two hundred fifty-one students and the one 
hundred thirty-eight alumni were obtained. The Pearson 
product-moment correlation coefficient between these medians 
for the ten traits was .92. On the basis of the obtained medians 
the rank order correlation was also computed to be .92, either 
method indicating a strong degree of relationship between rela- 
tive importance attached to the various rating traits by students 
and alumni. In Table 3 one can see that seven of ten traits have 
identical rankings by students and alumni. Trait 2, ‘Sympa- 
thetic Attitude Toward Students,’ is ranked fifth in importance 
by students and sixth by alumni. Trait 3, ‘Fairness in Grading,’ 
is ranked sixth by students and eighth by alumni. Trait 6, 
‘Sense of Proportion and Humor,’ shows the greatest discrepancy 
between students’ ranking and alumni ranking in that it is ranked 
eighth by students but fifth by alumni. Table 3 lists the traits 
in the order of importance by student ranking and gives the 
median rankings by students and alumni. 

The difference in emphasis placed on such traits as ‘Fairness in 
Grading’ and ‘Sense of Proportion and Humor’ by alumni and 
students lends itself readily to speculation. Grades unquestion- 
ably assume their greatest importance to the individual when 
set as immediate goals but the alumnus, as his academic days 
recede, must gradually realize the over-emphasis placed upon 
grades in their relation to later success. As for ‘Sense of Pro- 
portion and Humor,’ the student is possibly too much concerned 
with his academic progress, has too much seriousness of intent to 
place much premium upon this trait. The alumnus, on the other 
hand, possibly has realized the importance of fun and humor to 
individual adjustment and has learned how to relax when relaxa- 
tion is needed. 

These trait rankings compare favorably, although not per- 
fectly, with a much earlier study in which another group of 
students ranked the traits.! In general these students showed & 
high degree of agreement in their judgments of the relative 
importance of the ten traits, with the exception of ‘Fairness in 
Grading. The highest three in order of relative importance 
were 'Presentation of Subject Matter, 'Stimulating Intellec- 
tual Curiosity,’ and ‘Interest in Subject. The lowest were 
‘Personal Peculiarities,’ ‘Personal Appearance’ and ‘Sense of 
Proportion and Humor.’ 
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Comparison of Student-Alumni Ratings of Instructors.—In 
obtaining a comparison between student and alumni ratings of 
the same instructors two types of analysis appeared desirable— 
that which would give a measure of the degree of relationship 
between the ratings and that which would give a measure of the 
amount and direction of any average difference that occurred 
for a given trait. We will first discuss the correlations obtained 
between student and alumni ratings of the same instructors for 
each trait. 


TABLE 3.—RANKING or PRSI TRAITS ву STUDENTS AND ALUMNI 


Student Alumni 
Rank Rank St Al 


Trait Order Order Mdn Mdn 
Presentation of Subject Matter h . 4 .9 1.3 
Interest in Subject 2 2 2.1 2.0 
Stimulating Intellectual Curiosity 3 3 8.5 2.5 
Liberal and Progressive Attitude 4 4 4.1 4.7 
Sympathetic Attitude toward Stu- 
dent 5 6 4.6 5.3 
Fairness in Grading 6 8 4.8 6.1 
Self-Reliance and Confidence 7 7 5.6 5.8 
Sense of Proportion and Humor 8 5 6.0 5.0 
Personal Appearance 9 9 8.7 8.7 
Personal Peculiarities 10 10 8.7 8.8 


In obtaining correlations between student and alumni ratings 
for instructors it was necessary to correlate the sum of a given 
number of alumni ratings with the sum of the same number of 
Student ratings for each instructor. This procedure was repeated 
for ten traits, giving in all ten correlation coefficients. Here the 
paucity of our data first became apparent. We had the choice of 
basing our correlations upon the sum of two student ratings 
against two alumni ratings for the same instructor (in which case 
We would have seventy-seven out of the one hundred two 
Instructors represented in the comparison) or of basing the corre- 
lations upon the sum of eight student ratings against eight 
alumni ratings which would enable us to use only seventeen out 
of the one hundred two instructors. Although the number of 
Cases of instructors entering the correlation would be only seven- 
teen, it was decided to use the latter method because of the 
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superior reliability of the variables (the sum of eight ratings 
instead of only two). Inan early study it was found that ratings 
by from ten to twenty students on a single trait for instructors 
‘differing sensibly in the amount of the trait possessed yield 
reliabilities which compare favorably with the reliabilities 
reported for standardized mental and educational tests."5 In a 
recent investigation ratings based on the average of ten ratings, 
randomly selected, of two hundred five instructors, correlated 
against ten other ratings of the same instructors, randomly 
selected, had reliabilities ranging from .72 to .87.! 


TABLE 4.—EsrrMATION or RELIABILITY OF PRSI Trarrs BASED 
ON THE CORRELATION оғ Erat Raters Versus ErGHT 
OTHER RATERS 


Reliability! Reliability 

Based on 10 X 10 Estimated for 

Trait No. Ratings 8 X 8 Ratings 
1 .86 83 
2 .76 72 
3 „72 67 
4 75 71 
5 „87 84 
6 78 ‚74 
(i 83 .80 
8 82 .79 
9 .83 .80 
10 .84 81 


For this study, reliabilities of the average of eight randomly 
selected ratings against eight other randomly selected ratings 
were estimated from the above Study! by the Spearman-Brown 
Formula. These estimated reliability coefficients, shown in 
Table 4, vary from .67 to.84. "This is evidence that the measures 
of student and alumni judgments that comprise the variables in 
our relationships are fairly reliable. Of course, to the extent that 
these measures are not reliable, the obtained relationships shown 
in Table 5 between student and alumni ratings are lower than 
they would be with a larger number of ratings per instructor. 

As can be seen in Table 5, the correlation coefficients range 
from .40 to .68, indicating a substantial correspondence between 


uo 
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student and alumni ratings of the same instructors. These 
measures indicate that to a large extent the same relative ratings 
are given to instructors by current students whose average age is 
about twenty-two years and by alumni with an average age of 
thirty-three years. 


TABLE 5.—COEFFICIENTS OF CORRELATION BETWEEN THE SUM 
or Ercut STUDENT RATINGS AND THE SUM OF EIGHT ALUMNI 
RATINGS oF SEVENTEEN INSTRUCTORS FOR Ten PRSI 


TRAITS 
Traits т 
1. Interest in Subject .40 
2. Sympathetic Attitude toward Students — .68 
3. Fairness in Grading AT 
4. Liberal and Progressive Attitude „59 
5. Presentation of Subject Matter .98 
6. Sense of Proportion and Humor .46 
7. Self-reliance and Confidence .64 
8. Personal Peculiarities .50 
9. Personal Appearance .65 
10. Stimulating Intellectual Curiosity .46 


Next it was desirable to investigate the actual differences that 
occurred in comparing ratings by students and alumni. For 
this analysis it was possible to use most of the ratings received, 
Ог all the ratings on ninety-two of the one hundred two instruc- 
tors on whom we had at least one rating by both students and 
alumni. The procedure for each of the ten traits was simply to 
Compute, regardless of the number of raters, the mean alumni 
and student rating received by each instructor as representative 
of student or alumni judgment concerning that instructor. 
These mean ratings were then’ averaged for the ninety-two 
instructors and the average differences tested by computing the 
Standard error of the differences between means, taking into 
account the correlation between the measures. Based on the 

ata from this investigation, a significant difference between 
ese averages for a given trait would then represent a true 
tendency for students or alumni to rate instructors higher or 
Ower by a given amount. 


On three traits, ‘Interest in Subject,’ ‘Sense of Proportion 
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and Humor’ and ‘Self-Reliance and Confidence,’ students tend 
to rate instructors higher than do alumni. These differences of 
4 to 5 points are significant at the ninety-nine per cent level of 
confidence. On one trait, ‘Fairness in Grading,’ alumni tended 
to rate instructors about 3 points higher than did students. 
This difference was significant at the ninety-five per cent level of 
confidence. Complete results of this type of analysis are given 
in Table 6. In addition to the above significant differences 
which we have pointed out, there appears a slight tendency for 
students to give slightly higher ratings than alumni on most traits. 
Alumni are also considerably more variable in their ratings on 
Traits 1, 7 and 9. 

The tendency for students to rate instructors lower than do 
alumni on ‘Fairness in Grading’ may possibly reflect again the 
abnormal concern of undergraduates with grades and grading 
methods. For the rest of the traits, however, either there is no 
significant difference or the students tend to rate instructors 
slightly higher than do alumni. 

Teacher criticisms of the Purdue Rating Scale for Instructors 
made on grounds of student immaturity probably are founded 
upon the belief that undergraduates are not likely to give instruc- 
tors their due. Our results suggest otherwise; students of this 
study have tended to rate the instructors of this study higher 
than have alumni on two traits but not much differently than 
alumni on the other eight traits. On the other hand, superior 
ratings by students may reflect just those changes that have 
occurred in teaching during the past decade, leaving the distinct 
possibility that there actually are no differences i in the way alumni 
and undergraduates rate the same instructors. In all fairness, 
however, we should consider the possibility that the change for 
the better in teaching ability of the ninety-two instructors was 
so great that these slightly superior student ratings actually are 
under-ratings of a superior teaching ability. 


SUMMARY AND CONCLUSIONS 


To test the hypothesis that ratings of instructors do not change 
with the maturity of the rater, comparisons were made of the rat- 
ings of ninety-two Purdue University instructors by one hundred 
thirty-eight alumni of at least ten years’ standing with ratings 
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by two hundred fifty-one current undergraduates. The relative 
importance of the ten traits of the Purdue Rating Scale for 
Instructors to alumni and students was also examined. The 
following tentative conclusions appear justified concerning the 
comparative ratings of Purdue University instructors by current 
students and alumni of ten to thirteen years ago: 

1) There are substantial positive relationships between the 
relative average ratings of instructors by students and alumni. 

2) The average differences that do occur between student and 
alumni ratings of Purdue University instructors indicate that 
present students as a group rate thcir instructors slightly higher 
than they will as older individuals, but that such differences are 
actually too small to be of practical significance. 

3) Purdue University students and alumni agree highly upon 
the relative importance to good instruction of the ten traits of the 
Purdue Rating Scale for Instructors. 

These conclusions hinge upon the satisfying of the general 
assumption that the selections of students, alumni and instruc- 
tors did not account for the results obtained. In particular, 
results in favor of student ratings over alumni ratings for the 
same instructors may reflect improvements in teaching traits of 
the ninety-two instructors over the period covered by the study. 

This study, then, has presented evidence that the judgments 
made by undergraduates of their instructors are valid ones in 
terms of permanence and maturity. Instructors should be able 
to avail themselves of the Purdue Rating Scale for Instructors 
with increased confidence that. the judgments they receive 
thereby are worth-while ones in evaluating their own teaching 
personalities. 
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SOCIAL PERCEPTION AND TEACHER- 
PUPIL RELATIONSHIPS 


N. L. GAGE and GEORGE SUCI 
Bureau of Research and Service 
College of Education 
University of Illinois 


How two or more persons interact in a given situation depends 
on many variables, only a few of which have been isolated even 
conceptually. Properties of the persons and of their situations, 
all considered as interdependent aspects of a field of forces, obvi- 
ously provide handles by which to grasp the interaction phe- 
nomena. ‘This paper seeks to throw light on interactions between 
teachers and pupils as a function of one property of the teachers: 
the accuracy of their perception of pupils’ attitudes. 

We are concerned with the more affective dimensions of the 
interaction, rather than with cognitive ones. Our reasoning 
goes as follows: Behavior in any situation is a function of one's 
perception of the situation. The ‘appropriateness’ of the 
behavior will hence depend, at least in part, on the correctness 
or accuracy of the perceptions. But mere perceptions do not 
govern behavior completely; the motivational system of the 
person will determine the ends to which his perceptions are used. 
Similarly, his ‘integration,’ or freedom from neuroticism, will 
determine how well he can control his behavior to accord with 
his motivations and perceptions. Thus, even if John perceives 
a stop light accurately, he will not stop for it unless he wants 
to and is sufficiently unexcited to be able to react in time. If 
John perceives his date’s boredom with a movie, he will not sug- 
gest that they leave unless he both wants to please her and this 
motive is integrated in a given way with his own feelings about 
the movie. 

So far, however, this formulation ignores the relationships 
between these determiners; motivation and perception, at least, 
are themselves linked together. As Bruner! recently summarized 
it: 

“(a) Personally relevant objects in the perceptual field, 
whether the relevance is а function of positive or negative 
value to the individual, undergo accentuation. . . . 

"(b) Perceptual selectivity . . . is Shown to favor the 
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recognition of valued objects and objects associated with the 
prevailing interests of the subject.” 


. Applied to teachers’ perceptions of pupils’ attitudes and their 
interaction with pupils, this implies that the accuracy of teach- 
ers’ perceptions will be a function of the way in which teachers 
value pupils and relationships with them. Miss Smith will tend 
to become aware of how her pupils feel about various issues to 
the degree that she is interested in those pupils and in getting 


along smoothly with them. Similarly, she will probably act 


Upon her awareness of their attitudes in positive ways for the 
Same reasons that motivated her to perceive them accurately. 

hus certain patterns of motivation, perception and behavior 
tend to go together. At the one extreme of a continuum, we 
may have teachers who do not value pupils positively, do not 
Perceive their attitudes accurately, and behave in ways con- 
ducive to negative reactions. At the other extreme are teachers 
Who ‘need’ their pupils more, perceive them with greater sensi- 
tivity and understanding, and conduct themselves in ways that 
elicit positive affect from pupils. 

But, it may be objected, need does not necessarily lead to 
accuracy of perception. The more an object is valued, the more 
indeed may perception of it be distorted. In our framework, 
thi 5 leads us to examine what it is we are asking teachers to per- 
Ceive. This, as will be described below, was the attitudes of 
Pupils as reported by themselves in answer to direct Yes-No 
Questions, Whether the attitudes so reported are ‘true’ or ‘real’ 
ones, we cannot know. Itis reasonable to suppose, however, that 
E at pupils report about themselves in a nonclinical, classroom 
Situation are probably opinions of an ego-supporting kind. The 
Opinions of the pupils tended, in other words, to be those which 
ould enhance their own view of themselves. When teachers are 
; on asked to estimate these opinions, they are being Let to 
Бе what are the ego-supporting responses of pupils. Teac n 
9 value pupils positively then should come closer to the ририв 
e jme of themselves. Such a 'coming closer’ is what we 

Ve here termed ‘accuracy of social perception. " E. 

In Short, this should ns that teachers who perceive their 
Pupils’ attitudes more accurately should be regarded at Mel 
lY by their pupils. To test this inference, we need ш 2 
of (1) the accuracy of teachers’ perceptions of pupils’ attitudes, 


wh 
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(2) the favorableness of pupils’ attitudes toward their teachers, 
and (3) the relationship between (1) and (2). 


THE ESTIMATE OF ACCURACY OF SOCIAL PERCEPTION 


Ideally, we should deal with the teacher's perception of atti- 


tudes of individual pupils on matters that are deeply relevant to 


each pupil. This would mean, first, the identification of attitude- 
objects that are highly salient for each pupil and, second, asking 
the teacher to estimate that pupil’s attitude toward those 
objects. The attitudes to be perceived would then differ from 
one pupil to the next. Such a procedure was manifestly too 
difficult for the present study. We compromised by selecting 
areas of attitude that we surmised to be significant to the pupils 
en masse, and we asked the teachers to estimate the group attitude 
on each topic. This procedure is admittedly gross; but what- 
ever support for our hypothesis might emerge from such an 
approximation might then be considered an underestimate of its 
true validity. ы 
Accordingly, we proceeded as follows: The twenty teachers of 
a high school were asked to estimate what per cent of the two 
hundred pupils in the school would respond affirmatively to a set 
of sixty-seven opinion items. The items dealt with scholastic, 
recreational, and student government issues in their school.* 
An illustrative item of each kind follows: 
Scholastic: “Should students with high scholastic ratings be 
allowed to skip classes?” 
Recreation: “Could the time spent in school activities be used 
better for studying or working?” 
Student government: “Should Student Council members be 
appointed by teachers rather than elected by students?” 
The students responded anonymously, underlining ‘Yes’ or ‘No’ 
for each item. The pupils’ ‘Yes’ responses were tabulated and 
the percentage of Yes’s found for each item. These percentages 
comprised the scoring key. Each teacher was scored by taking 
the difference between his estimate and the actual percentage 
for each item, summing, and, because a few teachers omitte 
some items, averaging over-all items. The signs of the differ- 
ences were disregarded. Such ‘mean error’ scores were also 
obtained separately for each of the three subgroups of items. 


* These items were adapted from those used by Wood.‘ 
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These ‘mean error’ scores are directly dependent on the abso- 
lute accuracy with which each percentage is predicted. But a 
teacher, although not able to predict, accurately in terms of 
absolute percentages, may be able to rank the items in order of 
relative acquiescence of the pupils. Accordingly, we also com- 
puted for each teacher a Pearsonian r between actual and pre- 
dicted percentages. This we called an ‘r-score.’ It correlated 
TI with the ‘mean error’ score, showing a possibly important 
difference between the two scoring methods. 


PUPILS’ INTERACTION WITH THEIR TEACHERS 


At a separate meeting, with the teacher absent, the pupils 
rated their six current teachers on fifty-two Yes-No-? items* 
typified by the following: 

“8. Is this teacher often ‘bossy ?’” | 

“14, Does this teacher think he or she is always right and the 
student wrong?” ` 

Again the papers were unsigned and pupils were assured their 
responses would remain anonymous. A score for each teacher 
Was obtained by scoring favorable and unfavorable pupil 
responses as 1 and 0, respectively, summing over-all items and 
averaging over-all pupils rating the given teacher. This measure 
we considered an approximation, adequate for this study, to the 
Positive affect elicited in pupils by their interaction with a given 
teacher, 

Furthermore, for an appraisal of each teacher’s system of 
values in teacher-pupil relationships, we used the Teacher Attitude 
Inventory developed by Leeds апа Cook.*t The two hundred 
thirty-nine items in this device had been empirically selected and 
Weighted by Leeds and Cook for their ability to discriminate 

tween teachers known to maintain very satisfactory and very 
Unsatisfactory relations with pupils, in the judgment of the 
teachers? local school administrators. 


RESULTS 
as to estimate the gener- 


Our first i i i 
St task in analyzing the data w our approach to 


ality over items, or the internal consistency, of 
ee 


used by Leeds and Cook.* 


* These i ificati i 
were a slight modification of those Y for permission to use this 


T We are grateful to Professor W. W. Coo! 


device, 
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accuracy to social perception. Table 1 shows the corrected odd- 
even coefficients for the ‘mean error’ scores on all items and on 
each of the three sub-groups. The coefficient for all items, .73, 
indicates that the accuracy of teachers in estimating percentages 
of acquiescence was fairly general over the items. Thus we have 
evidence that the task of judging opinion revealed individual 
differences among teachers that were substantially loaded with 
non-error variance. For the subgroups of items, these estimates 
yielded much lower coefficients. 


TABLE 1.—Correcrep Opp-Even RELIABILITY ESTIMATES FOR 
THE ‘MEAN Error’ SCORES on OPINION ESTIMATES 


N = 20 


Type of Items of 
Items | Mean | SD | Mean | SD Even т 


All Items 67 |20.192.81/]18.64]2.97| .73 
1-67 
Scholastic 23 |22.50/5.03|19.74|4.05| .17 
1-23 
Recreation 22 |15.47/3.13|18.16/4.98| .28 
24-45 


Student Government| 22 
46-67 


20.50 |5.07| 17.26 |4.95] .47 


Secondly, what is the reliability of the pupils’ ratings of their 
teachers? Table 2 shows the results obtained from an appli- 
cation of Horst’s formula.? This coefficient, .93, indicates that 
the mean ratings we obtained would correlate very highly with 
subsequent sets of similar ratings, when our estimate of the 
variability of such further mean ratings is based on an average 
of the standard errors of those obtained, In short, the variance 
among the mean ratings is even more a non-error one; the ratings 
discriminated well among the teachers. 

Having established these estimates of reliability, we turned to 
the relationships with which we were primarily concerned. Is 
social perception, defined operationally as mean error in esti- 
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mating students’ percentages of acquiescence to opinion items, 
related to acceptance of the teachers by pupils, defined as the 
mean rating of teachers by pupils? Table 3 shows the pertinent 
coefficients of correlation. The 7’s between mean rating and 
mean error for all items and for the three subgroups of items are 
~.37, —.16, —.30, and —.18, respectively. It is evident that 
al rs are in the direction inferred from our hypothesis: the 
Breater the cher's mean error in estimating student opinion, 
the lower his'mean rating by students. None of these 7’s are 
ad significant. Our interpretation of this fact may, 
at i, be tempered somewhat by the consistency in direction 
зра ize o the three subtest coefficients. These subtests provide 
The sense three semi-independent trials of our investigation. 

consistency of their results may therefore be construed as 


alt pag evidence in addition to that provided by the over-all 
ST. 


TABLE 
ABLE 2.—Estrmars ny Honsr's METHOD OF THE RELIABILITY 
or Purius’ RATINGS оғ THEIR TEACHERS 


o? 
PE 
pele = ee 

= 93 


where N = number of teachers 
^; = number of pupils rating teacher t 
М; = mean of the ratings for teacher? - 
о; = standard deviation of ratings for teacher i 
см; = standard deviation of means for the N teachers 


ana the teachers' estimates of student opinion were scored in 
thi S of their correlation with, rather than their difference from, 
9 actual percentages, we obtain the results also shown in 
на 3. Неге the relationships, using 7 and 2, as measures of 
о uracy of social perception, increase to .50 and .45, respectively. 
Si its these coefficients meet the requirement for statistical 
nificance at the five per cent level. 
ind do the т-всогев correlate more high -— d 
follo with the pupils' ratings? We can only e: d 
8 ws: The т-всогев are not influenced, as аге t o me 1 
Cores, by individual differences among teachers n adaptation 


ly than ihe mean error 
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level,’ or *anchor-point. The teachers differed very significantly, 
beyond the one per cent level, in the means of their predicted 
percentages. The r-scores eliminate the effect of these differ- 
ences. They render the measure of accuracy in social perception 
dependent solely on relative rather than absolute judgments of 
degree of acquiescence. 

Two further findings should be mentioned. First, as shown in 
Table 3, the scores on the Cook-Leeds inventory correlated .57 
and .46 with our mean error and r-scores, respectively. This 
indicates that the attitudes and understandings concerning pupils 
which are tapped by that test are significantly related to ability 
to estimate students’ opinions. But what of the relation of the 
Cook-Leeds instrument to mean ratings by pupils? Contrary to 
the Cook-Leeds findings, our coefficient was negative, —.20, 
although not significantly different from zero. In this school, 
at any rate, this test did not yield results in corroboration of the 
Significant positive relationships with pupils’ ratings (about 45) 
Previously reported by Cook and Leeds. 


DISCUSSION 


All our conclusions must be tempered by an awareness of the 
Smallness of our sample and its lack of replication in other schools. 

or example, our impression that a curvilinear relationship exists 
etween pupil ratings and accuracy of perception cannot ade- 
quately be pursued. It should be reported, however, that six 
teachers with high mean ratings nevertheless made only mediocre 
mean error’ or “т? scores. None of the teachers with very low 
ratings made high accuracy in social perception scores. This 
Could have occurred if some of the well-liked teachers did not 
attack the task of estimating pupils’ opinions with sufficient 
motivation. Thus low ratings seem sufficient to indicate poor 
Perception scores, but the converse is not true. " 

The instability of our results is further indicated when we om! 
One extreme case from the calculations of the r's between the two 
Scoring methods and the mean ratings. With the one case 
retained, r’s of —.37 and .50 were obtained with the ‘mean error 
Score and the ‘r-score,’ respectively. With the extreme 5 
Omitted, the r’s became —.24 and .18, respectively 79 const s 
able reduction. Nevertheless some degree of correlation, 1n the 
expected direction, persisted. 
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SUMMARY 


To test the hypothesis that accuracy of social perception is 
positively related to effectiveness of interpersonal relations, we 
asked the twenty teachers of a high school to predict the per- 
centage of the two hundred students who would answer ‘Yes’ 
to each of sixty-seven items eliciting opinions on various aspects 
of the school. Teachers’ predictions were scored in terms of 
(a) ‘mean error’ from actual percentages and (b) correlation 
with actual percentages. The teachers were rated by their pupils 
on a fifty-two-item inventory. Finally, the teachers filled out 
the Cook-Leeds Teacher Attitude I nventory. 

Results support the hypothesis. The teachers’ ‘mean error’ 
scores had fair internal consistency (corrected odd-even т, 73) 
and correlated —.37 with mean rating by pupils. Their ‘r-scores’ 
correlated .50 with mean rating. The teachers’ scores on the 
Teacher Attitude Inventory correlated .57 with the ‘mean error’ 
scores but, unexpectedly, —.20 with mean ratings. (For № = 20, 
an r of .44 is significant at the five per cent level.) 

Our results must, of course, be pursued through replications in 
other schools and other situations, Tentatively, however, we 
conclude that teachers’ accuracy of social perception is posi- 
tively related to their effectiveness in eliciting positive affect in 
pupils. 
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THE READING EASE, HUMAN INTEREST VALUE, 
AND THEMATIC CONTENT OF ST. 
NICHOLAS MAGAZINE: A STUDY 
OF CHILDREN'S LITERATURE 


BARBARA SWARD and DALE B. HARRIS 
Institute of Child Welfare, University of Minnesota 


Perhaps the best known and most widely used technique for the 
analysis of written prose has been proposed by Flesch.??4 His 
formulae are extensively used by journalists, writers of articles 
for trade magazines, and others. Although many techniques 
for the analysis of educational material prepared for children 
have been developed, little work has been done on prose specifi- 
cally designed for children's entertainment. 

Anyone professionally concerned with child development or 
education is familiar with the impression that stories and books 
for children have improved greatly in recent years. There is a 
widespread impression that children's literature of the Victorian 
era was stilted, artificial, highly moralistic. The writers, inter- 
ested in this subject and in the adaptation to children which has 
presumably occurred in the informed adult world as a result of 


scientific study of children, here attempt an analysis of two 
Problems. They are interested in the ‘readability’ of selected 
children’s material of an earlier day and of the present. They 
аге also interested in the ideological content of this material, and 
ow it may have changed over the years, due to changing con- 
ceptions both of children and of social values. 
For the first problem, the Flesch formulae suggest themselves 
aS convenient indices of ‘Reading Ease’ and of ‘Human Interest. 
de formulae, their rationale and derivation are available and 
vill hot be discussed here. For the comparative purposes of 
„18 paper, two monthly children's magazines were selected. 
Ne Nicholas, the ‘grandfather’ in its field, commenced publica- 
tion in 1873 under the editorship of Mary Mapes Dodge. Tt 
enjoyed wide popularity until it ceased publication in 1940. m 
an earlier day, its pages were crowded with the work of suc 
noted writers as Louisa May Alcott, Kipling, Twain, Bret Harte, 
homas Bailey Aldrich, William Cullen Bryant and ag 
Child Life, which, of the modern children’s magazines, has the 
153 
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longest continuous publication and the widest circulation, com- 
menced publication in 1922 and enjoys considerable repute today. 

To obtain materials for analysis, the writers proceeded as fol- 
lows: Samples of prose from both magazines were taken from 
issues published in successive decades. In order to utilize the 
first issue of St. Nicholas, the November, February, May, and 
August issues of the year 1873-4 were selected to yield the first 
sample. Comparable issues of succeeding decades gave addi- 
tional samples. The same months were used for the Child Life 
series, but, because a complete file was unavailable to the writers, 
the analysis began with the 1925-26 period. Thus, counting 
both magazines, a seventy-three year period is covered, 1873 to 
1946, inclusive. 

For each selected monthly issue of each magazine (twenty- 
eight issues for St. Nicholas and twelve for Child Life), the first, 
third, and fifth fictional stories provided the material for analysis. 
From each story, two one-hundred word samples were taken, one 
sample beginning with the third paragraph and one sample 
beginning with the fifth paragraph.* The first, third, and fifth 
stories were used consistently except where this procedure would 
include a succeeding installment of а serial story already sampled, 
or another story by an author already sampled; then, the story 
immediately following the designated story was used. Few, if 
any, of the monthly issues contained more than five or six such 
fictional stories. 

In each case, a fictional story was considered to be a story that 
was pure fiction or fictionalized history in prose (many of the 
Washington and Lincoln stories for children are of this latter 
type), and of at least a page or more in length. Plays were not 
used because extensive dialogue would make the ‘personal 
sentences’ percentages in the Flesch formula spuriously high. 
Serial stories were used, but in counting paragraphs, the synopsis 
section was ignored as being abbreviated and very non-personal. 

Flesch’s Reading Ease (R.E.) score is easy to compute and 
quite objective. It is based on the average number of words per 


* We selected the third and fifth paragraphs in an effort to cover ade- 
quately two types of writing. The third paragraph frequently caught the 
introductory variation or exposition, while the fifth usually included more 
dialogue or light, personalized writing. 

1 We avoided using more than one story by the same author because We 
were interested in the variety of writers representing a particular period. 
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Sentence ror 

words, poen = ч аке number of syllables рег one hundred 
јене of dutem — (H.I.) score involves greater sub- 
words’ and the rois t ‘bi the number of ‘personal 
mus imde wed єл of ‘personal sentences’ per sample of 
evident, The writ s. ‘Personal words’ are not always self- 
ө ЫА ‘an ers encountered many nouns which could not 
ова ef rw to possess masculine or feminine gender, yet 
consider Chern Fig n use in the story it seemed wise to 
Bumblebee en 2 Examples are: Lady Hollyhock, Buster 
rule adopted en = de mongoose Rikki-Tikki-Tavi, ete. The 
Personalized and anode non-human characters were definitely 
counted as E = gender, nouns designating them were 
— they were = ciu у-н er 
ABLE I.—Mr l 

vs a AND SEMI-INTERQUARTILE RANGE VALUES 
i ASE SCORE DISTRIBUTIONS FOR SELECTED YEARS 
a 

ear Medi "у 
A di Iedian К.Е. Score Q Flesch Description of Style 


1873-4 7 
1883-4 d 9.4 5.3 Fairly easy 
1893-4 76.7 7.7 Fairly easy 
1903-4 80.7 9.4 any 
1913-4 80.9 6.2 Easy 
1923-4 80; f 5.6 Easy 
1933-4 294 6.0 Fairly easy 
1925-6 
1935-6 75.6 7.8 Fairly easy 
1945-6 84.6 4.7 Easy 

78.4 6.3 Fairly easy 


The medi 
ed 

Presented T геа scores for St. Nicholas and Child Life are 

Orrowed f ‘able I. The descriptions of style in the table are 

rom Flesch's designations for adult material. 

’ the functional use of the 
d's absolute or commonest 
tethisrule. The problem 
h technique has been 
ve material prepared 


* т z 

Word азы that in deciding ‘personal words 
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The outstanding result of this analysis is the fairly uniform 
level of reading ease of the material over three-quarters of a 
century. One might expect that the stress in recent decades on 
simplified, pictorialized literature for children might have brought 
with it a somewhat higher typical R.E. score derived from the 
prose. The great change in format of children’s material is 
apparent to all, but the early issues of St. Nicholas, with their 
few, black-and-white pictures, and small print, were just as 
‘easy’ in prose as the modern children’s magazines. 


TABLE II.—MEDIAN AND SEMI-INTERQUARTILE RANGE VALUES 
ron Human IwrEREST SCORE DISTRIBUTIONS FOR SELECTED 
YEARS 

Magazine 
and Year Median R.E. Score Q Flesch Description of Style 
St. Nicholas 


1873-4 51.6 19.7 Highly interesting 
1883-4 71.9 26.8 Dramatic 
1893-4 72.4 27.9 Dramatic 
1903-4 55.9 19.7 Highly interesting 
1913-4 56.5 18.0 Highly interesting 
1923-4 64.2 18.7 Dramatic 
1933-4 64.7 15.3 Dramatic 
Child Life 
1925-6 57.6 19.9 Highly interesting 
1935-6 64.4 15.0 Dramatic 
1945-6 57.0 21.2 Highly interesting 


Human interest scores are presented in Table II. The appar- 
ently greater variability among these medians must be inter- 
preted in the light of the greater basic variability in the score 
itself. The greatest difference—that between the years of 
1873-4 and 1893-4—is significant only at the five per cent level, 
statistically; that is, the chances are still five in one hundred 
that a difference as large or larger than the observed one could 
occur from ‘errors’ of sampling. Again, the high interest value 
of children’s literature in another ега must be noted. Small 
wonder that Henry Steele Commager’s anthology* from St. 
Nicholas has been so well received. 


* Henry Steele Commager (Editor), The St. Nicholas Anthology. New 
York, Random House, 1948. According to the publishers, approximately 
fifty thousand copies of this anthology have been sold. 
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Two additional analyses are perhaps of sufficient interest to 
note the general results in passing without presenting tabular 
detail. 'The reading ease of children's material results more 
from the selection of short, simple sentences. An analysis of 
mean sentence length reveals the interesting fact that, judged by 
sentence length alone, children’s prose rates ‘fairly easy’ to 
‘fairly difficult’ by Flesch’s norms. When mean number of 
syllables per one hundred words is calculated, the Flesch norms 
of ‘easy’ or ‘fairly easy’ are satisfied. Again, these indices are 
Surprisingly constant over the seventy-three-year period studied. 
, In the St. Nicholas material, the November and February 
issues, for all years, were consistently above May and August 
issues in Human Interest score. The relationship to Thanks- 
Siving Day and to Valentine's Day, Lincoln's and Washington's 
birthdays is apparent. Probably the December issues would 
exceed even the "Thanksgiving issues in this regard, although this 

Чпећ was not investigated. 

Interesting as the results of word counts may be, such analyses 
miss completely the content of the material. ‘Content analysis’ 
has attracted the attention of journalists and social psychologists 
for some years. Of several techniques investigated, that pro- 
Posed by Child and his associates! and applied by them to third- 
Stade readers appeared to be most useful. The method consists 
m analyzing the behavior of principal characters in selected 
Stories according both to the presumed motives of those char- 
acters and to the consequences of their behavior. | | 

Тһе psychological theory of behavior which lies behind this 
Method is obvious. It is that children learn motives from observ- 
Mg the motives of persons they see or about whom they read. 

€ assumption is made that the written page is an important 
Source of conduct motivation in children, a position which has 

Сеп and is implicit in a great deal of educational enterprise. 

gardless of whether children’s conduct is measurably affected 

Y Such material, one may analyze the material to discern the 

Inds of values set before children three-fourths of a century ago 
and more recently. 3 

For this ‘content analysis,’ stories are selected according to the 
following criteria: (a) stories must contain action by animate 
characters, (b) they must not be essentially humor stories, for in 
Such stories behavior and its consequences are frequently dis- 
torted for comic effect, and (c) they must not limit behavior 
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descriptions to purely objective and external accounts—evalua- 
tion of behavior and its consequences must be implied (or at least 
the possibility of such evaluation must be implied). Judged by 
these criteria, the stories of St. Nicholas are excellently suited to 
analysis. They are full of people to whom many things happen; 
consequences of behavior are very apparent; it is easy to reach 
an evaluation of the consequences as desirable or undesirable for 
the character involved. 

Stories which satisfy the above criteria are then analyzed in 
thema. A thema is a ‘sequence of psychological events,’ con- 
sisting of (1) a situation confronting a person or animate being, 
(2) the behavior, internal or external, with which the person 
responds, and (3) the consequences of the behavior as felt by the 
person or animate being himself. This third aspect of the thema, 
the present writers would restate as ‘consequences of the 
behavior as felt by the person himself or as inferred to him by the 
reader. In Child's work with materials prepared for third-grade 
children, consequences were usually verbalized. St. Nicholas, 
designed for more mature children, sometimes presents conse- 
quences in very subtle, inferential ways, almost beyond stated 
feelings at times. 

Once thema are identified, they are classified in terms of an 
elaborate set of categories based by Child on Murray's? personal- 
ity ‘needs.’ The writers used Child's categories and, with occa- 
sional simplifications, his definitions. The categories appear in 
Table III. Complete definitions of the categories are eliminated 
in the interest of brevity, but some examples follow (adapted from 
Child): 

Activity.—Thema in which activity is engaged in for its ow? 
sake, and the emphasis in the story is on the value of the activity 
itself. 

Achievement.—Incidents in which characters show either ® 
generalized ambition to succeed or a desire for specific physical, 
intellectual, or social success. 

A ffiliation.—Thema including manifestations of friendliness 
and good will, and of the desire to do things in company wit 
others. Often demonstrated through respect, deference, SY™ 
pathy, generosity and helpfulness. 

Nurturance.—Thema in which helpfulness and willingness to 
exert oneself to aid any creature that may be in need of assistance. 


LIMES. — 


| 
| 
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Taste IIl— TuEMas Founn IN EacH BEHAVIORAL CATEGORY 
ror EACH or THE Four SAMPLED YEARS OF ST. NICHOLAS 


* O6 Oo 0 00-1 


1873-4 | 1893-4 | 1913-4 | 1933-4 
Category Per |... | Per |x, | Per | мо, | Pet 
No.) cont Ко. cont No.) cont No. | cent 
Objectless Behavior 
Activity 8 7.4) 6 3.6] 4 1.7| 14| 5.6 
^ Passivity 1 .9 2| 1.2 2 .8 0| 0.0 
rh Sentience а 1.8 1 .6 0| 0.0 0| 0.0 
f Elation 2| 18 2| 12 3| 1.3) 2 8 
Total 13 | 11.9 11 | 6.0 9| 3.8 16] 6.4 
| Behavior Primarily in Rela- 
tion to Things and Events 
Cognizance 1 .9| 10 | 6.0} 28 | 11.7 24 | 9 
Achievement 16 | 14.7] 23 | 14.0| 37 | 15.5| 34 | 13 
Construction 1 .9 2| 12 5] 2.1) 2 
Imaginality 0| 00 6| 3.60 0| 0.0) 1 
Acquisition 4| 38.7 6| 3.6 2 S 5| 2 
Retention 2| 1.8) 1 .6 0| 00, 0| 0 
Order 2| 2.8) 1 .6 1 A 1 
Total 26 | 23.8| 49 | 29.0 73 | 30.5) 67 | 27.1 
Altruistic Social Behavior 
Affiliation 10 9.2| 17 | 10.2| 61 | 25.5) 70 28.3 
Nurturance 16 | 14.7| 22 | 13.3] 12 | 5.0) 11 4.4 
Succorance 6| 5.5 6| 3.6 9| 3.8) 7] 2.8 
Deference 5| 46 11| 66 4| 1.7 2| .8 
;Praying for others 1 .9| 1 .6 0| 0.0 0| 0.0 
Appreciation 2| r8 3| 18 2 .8 0| 0.0 
| Total 40 | 36.7] 60 | 36.1] 88 | 36.8] 90 | 36.3 
Egoistic Social Behavior 
| Aggression 3| 2.8 14 | 8.5] 18] 7.6 19| 7.7 
Dominance 8| 7.3 7| 4.2] 11| 4.6 10| 4.0 
T Recognition 0| 0.0 1 .6 2 .S 0| 0.0 
Autonomy 4| 8.7 5| 3.0] 3| 5.4 2 8 
Rejection 8| 7.4 7| 42 11| 4.619] 7.7 
"Total 23 | 21.2, 34 | 20.5| 45 | 23.0| 50 20.2 
Avoidance Behavior 
Harmavoidance 4| 3.7 8| 48 7| 2.9 9| 3.6 
Blamavoidance 2| 18 4| 2.4 4| 1.7 9| 3.6 
1 Infavoidance 1 9| 0| 00 3| 1.3 7| 2.8 
Total 7| 6.4 12| 7.2 14 | 5.9| 25 | 10.0 
"Total of totals e 109 |100.0|166 |100.0,229 |100.0/248 100.0 


* Categories added by the writers. 
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Aggression.—Thema featuring displays of temper and of fla- 
grant disobedience; verbal forms of aggression such as criticisms 
and arguments; dominating others by bullying and teasing; 
physical attack and killing. 

Harmavoidance.—Efforts to escape or avoid sources of danger. 

The writers added two categories to those supplied by Child, 
which appeared necessary for the most accurate placement of 
thema. ‘These are starred in Table III. 

For the most part, the assignment of thema for categories was 
easy. When a single act might fulfill several purposes at the 
same time, and hence be assigned to multiple categories, the 
judgment was made in terms of the behavior which was pre- 
dominant or most conspicuous. When consequences of behavior 
were classified under the headings ‘reward,’ ‘punishment,’ ‘no 
consequence’ (neither reward nor punishment), the permanent, 
last, or long-run consequences were considered, not the immedi- 
ate consequences. 

The sample of stories selected for analysis was drawn at twenty- 
year intervals, beginning with the year 1873-4. The first two 
stories of at least a page in length in each month’s issue were 
used. There were in all ninety-six stories, twenty-four in each 
of four samples at intervals of twenty years. Serial stories were 
not included, and in only two instances was it necessary to include 
more than one story by the same author. 

Results are summarized in Tables III to V. The first of these, 
Table III, shows the number of thema represented in each year’s 
sample, and the proportions within each year represented in the 
several categories. The increase in gross number of thema 
observed in twenty-four stories reflects the increased length and 
especially the increased complexity of individual stories, which 
came somewhere around the turn of the century. Early issues 
contained many short stories. More recent decades have wit- 
nessed the introduction of mystery and adventure stories, where 
brother and sister hero-and-heroine combinations wander in and 


out of complex situations, exploring haunted houses, succoring . 


destitute widows, and having exotic adventures in foreign lands. 
Yet the percentages vary little among the categories of thema, 
from sample to sample. 

When the classes of categories are examined, the percentages 
appear very stable from period to period. There has been & 
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decline in the amount of ‘objectless behavior’ (activity engaged 
in for its own sake, emphasis on emotion or feeling, etc.) and a 
corresponding increase in ‘behavior primarily in relation to 
things and events,’ but the difference between 1873 and 1933 falls 
short of the five per cent level of significance in both instances. 
Certainly, the emphasis on more concrete, activity-centered 
stories has not increased over the years to the extent we perhaps 
have believed. 

The uniformly low percentages of avoidance behavior in all 
samples are of interest. Story characters have not and are not 
represented as seeking in their behavior to avoid physical harm, 
parental or social disapproval, fears, embarrassment, selí- 
consciousness or shyness. In general, thema are distributed as 
follows: one-fifth to egoistic social behavior, one-third plus to 
altruistic behavior, and one-fourth to behavior primarily related 
to things and events, especially the gaining of knowledge and the 
desire for success. This is true both for the Seventies of the last 
century and the Thirties of the present. 

The only differences which are statistically significant and 
which show a trend, occur within the category ‘altruistic social 
behavior.’ Here, there is a significant increase in behavior 
designated as * affiliation-manifestations of friendliness and good 
will and of the desire to do things in the company of others; often 
demonstrated through respect, deference, sympathy, generosity, 
and helpfulness." This increase is paralleled by decreases in 
‘nurturance,’ ‘succorance,’ and ‘deference.’ When extremes are 
compared, the decline in nurturance satisfies the one per cent 
level of significance. Nurturance is defined as “manifestations 
of helpfulness or willingness to exert oneself to aid any creature 
that might be in need of assistance." Succorance refers to 
* behavior directed at obtaining protection, sympathy, or assist- 
ance from another person," while deference indicates “behavior 
toward other persons involving (a) compliance with requests or 
commands, (b) politeness, (c) subservience, (d) respect for au- 
thority, and (e) imitation of other persons." In the last two 


categories, the trend is consistent but the shift is not statistically 


significant, at least in terms of samples of this size. 

Table IV gives the number of thema in the more popular cate- 
gories, all years combined, with the proportions in which the 
actor is rewarded, punished, or experiences no consequences of 
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TABLE IV.—CoNsEQUENCES OF BEHAVIOR IN SELECTED CATE- 


GORIES OF Turmas, ST. NICHOLAS Srorirs 


Percentage in Which 


Behavior Was: 
No. of 
Category Thema No 
Re- Pun- 
warded] ished Conse- 
quences 

Objectless Behavior 

Activity 32 :35 .25 -39 
Behavior Primarily in Rela- 
lation to Things and Events 

Cognizance 60 .82 .05 .13 

Achievement 109 .72 22 .06 

Construction 10 .50 .13 .97 

Acquisition 17 45 .33 22 
Altruistic Social Behavior 

Affiliation 158 79 .03 8 

Nurturance 61 1 .07 .22 

Succorance 29 75 .18 .07 

Deference 22 ‚Т1 ‚10 .19 
Egoistie Social Behavior 

Aggression 54 .44 .81 .25 

Dominance 35 .39 i7 Ae 

Autonomy 24 „82 .33 85 

Rejection 45 .08 11 .81 
Avoidance Behavior 

Harmavoidance 27 .61 12 -27 

Blamavoidance 19 .15 .28 .57 

Infavoidance 11 21 48 31 


his behavior. In general, altruistic social behavior is rewarded 
Egoistic social behavior is much 
less frequently rewarded; it is somewhat more likely to result in 
no consequences than to be punished. 
related to things and events, the seeking of knowledge (cog- 
nizance) is rewarded in the great majority of instances; behavior 
denoting the desire for material possessions (acquisition), or the 


about three-fourths of the time. 


In behavior primarily 
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creation of a material or intellectual product for utilitarian or 
esthetic use (construction) is rewarded about half the time. 

When the thema, distributed in the various categories by year 
samples, are broken down according to type of consequences, the 
number in any category becomes so small as to be relatively 
meaningless. The material, therefore, is not reproduced here. 
The totals, however, showed that for all categories combined 
there has been relatively little shift over the years in the tendency 
to reward or punish the consequences of behavior in stories. 
Consistently in samples taken at twenty-year intervals, behavior 
is rewarded in about three of five thema; it is punished in about 
one of six thema. For the remainder of the instances, no conse- 
quences follow from the behavior. An examination of the 
several categories of thema, such as objectless behavior, altruistic 
social behavior, egoistic social behavior, etc., shows that there 
has been no trend over the years to reward or to punish such 
classes of behavior in greater or less amount. 


TABLE V.—CHARACTERISTICS PORTRAYED IN 24 STORIES SELECTED 
in Eacn or Four Years, ST. NICHOLAS MAGAZINE 


1873-4 1893-4 1913-4 1933-4 

N Per N Per N Per N Per 

cent cent cent cent 
Child 35 52.2 | 31 32.0 | 41 31.8 | 29 21.6 
Adult 23 34.3 | 39 40.2 | 75 58.1 | 82 61.2 
Animal 4 6.0 | 16 16.5 5 3.9 | 11 8.2 
Fairy 0 0.0 5 5.2 3 2.3 2 1.5 
Groups of the above| 5 7.5 | 6 6.2] 5 3.9 | 10 7.5 
Total 67 | 100.0 | 97 | 100.1 [129 | 100.0 134 | 100.0 
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Table V contains some additional data of interest. The total 
number of characters portrayed, per sample of twenty-four 
stories, has increased steadily. This is in keeping with the 
observation made earlier, that stories are longer and more com- 
plex now-a-days. The proportion of child characters has been 
cut in half over the years covered by this survey, and the pro- 
portion of adult characters has almost doubled.* 


* These figures may, in part, reflect an increasing problem which the 
writers faced—that of determining the age of child characters. We took 
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It should be clear to the reader that this content survey covers 
only one source of children’s literature, and a top-grade one at 
that. Yet, one impression stands out. Despite two world wars, 
an industrial revolution which has altered almost beyond belief 
the material comforts and conveniences of living, very marked 
alterations in habits of family living, major shifts in our economic 
ideologies, and tremendous advances in the format of children’s 
reading materials themselves, the content of this sample of 
children’s literature has altered very little indeed. To be sure, 
in this study we have established no absolute norm against which 
to measure change. Possibly, another set of content categories 
would give more evidence of change. Yet, the categories used 
appeared adequate to the writers; none disappeared, and no new 
ones were required for analysis of more recent materials. 

The writers have carried from their study one or two impres- 
sions which cannot be substantiated from the tables, but which 
they feel inclined to report anyway. As stories become longer 
and more complex, there occurred a subtle shift in how child 
characters were portrayed. Children in stories of an earlier 
day were recognized as immature. Their interests, activities, 
preoccupations were not those of adults. They met failure and 
success, they were rewarded or punished, but as children, not as 
‘little adults.’ Stories of a later era not only included fewer 
child characters but presented children more frequently as solv- 
ing problems which baffled adults. While the industrious child 
of an earlier era was likely to win out over economic odds eventu- 
ally, the boy detective of a later era was just as likely to solve a 
baffling mystery. The child character of an earlier day won by 
using materials at his disposal; the child character of a later 
period won by using, many times, the equipment and materials 
ordinarily available only to adults. 

It has often been said that one major change in the thinking of 
adults in the last one hundred years has been to accord to children 
a life of their own, appropriate to recognized developmental 
levels. In one sense, however, the children's literature of an 
earlier day achieved this recognition somewhat more successfully 
than children's literature of a more modern time. 


age sixteen as a division point, and when ages were not indicated, we made 
the best judgment possible in terms of the content. 'The trend is too 
marked, however, to be accounted for in terms of unreliability. 
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The writers would like to suggest that somewhat different 
ideological dimensions, developed around the hypothesis just 
advanced, would be worth studying in samples of children’s liter- 
ature. Religious stories and pamphlets for children should be 
included, likewise. Possibly, here evidence of greater adaptation 
might be found. As far as St. Nicholas magazine is concerned, it 
was surprisingly modern, even in its early days: Whether that 
be an accolade to St. Nicholas’ early issues, or & condemnation 
of its later years, only further surveys of other materials for 
children can tell. 
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CORRECTIVE READING: A MEANS OF 
INCREASING SCHOLASTIC ATTAIN- 
MENT AT THE COLLEGE LEVEL 


DOROTHY J. McGINNIS 


Associate Director, Psycho-Educational Clinic 
Western Michigan College 


The purpose of this study is to describe and evaluate materials 
and procedures employed in doing corrective work in reading at 
the college level. Appraisal is made not only in terms of differ- 
ences in initial and final scores on a reading test, but in point- 
hour-ratios as well. In making this evaluation one control and 
one experimental group have been equated, resulting group data 
have been compared statistically, a brief history of an individual 
in the Reading Laboratory has been presented, and tentative 
inferences have been made. 


DESCRIPTION OF MATERIALS 


(1) The primary source of materials used in the Reading 
Laboratory at Western Michigan College is the Reading Manual 
and Workbook.' This book contains twenty-two specific assign- 
ments, each of which has been designed to aid the student in 
developing a definite reading ability and skill. The reading 
assignments are related to actual classroom situations and the 
student is given an opportunity to apply the suggestions as he 
does his daily class preparation. Reading and studying are con- 
sidered together. Assignments show how: 

(a) To discover the nature and extent of the student’s reading 
difficulties. (b) To aid in interpreting reading difficulties and 
in selecting the assignments upon which the student is to work. 
(e) To investigate the possibility of a visual defect which would 
interfere with reading performance. (d) To improve the stu- 
dent’s ability to use the different parts of a book. (e) To develop 
skill in reading for a particular point and for general ideas. (f) 
To develop ability and skill in outlining. (g) To develop skill 
in reading a chapter effectively and well. (h) To develop skill 
in associating facts obtained from a textbook with facts already 
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known. (i) To learn how to concentrate upon à reading activ- 
ity. (j) To inerease rate of reading without interfering with 
comprehension. (k) To develop skill in the use of the dictionary. 
(1) To increase reading vocabulary and to develop adequate 
skills in word study. (m) To develop skill in interpreting a 
short poem. (n) To develop skill in reading the newspaper 
effectively and well. (о) To develop ability and skill in problem- 
solving, especially in such areas as mathematics, chemistry, Or 
physies. (p) To develop ability to read a table or graph. (9) 
To develop ability to read a map. (r) To develop skill in the 
use of the eard catalogue. (s) To develop ability in using the 
Readers’ Guide. (t) To develop skill in applying what is read 
to the solution of one's personal problems. (u) To develop 
skill in reading selectively and in preparing for examinations. 
(у) To appraise the change of reading skills and abilities acquired 
during the time between the initial and the final testing. 

(2) Orientation I. nventory.— his inventory, which is a part of 
Reading Manual and Workbook, has been designed to help the stu- 
dent recognize and pick out the reading abilities and skills which 
he does not possess and at the same time it furnishes information 
concerning his reading background and certain physieal and 
emotional factors which may affect his reading performance. 

(3) Equivalent forms of the Iowa Silent Reading Test? have 
been used. “The test is designed to cover a wide range of the 
skills known to be indispensable to effective reading of the work- 
study type. The test measures three broad general areas of 
silent reading abilities; namely, (a) Rate of Reading at a Con- 
trolled Level of Comprehension, (b) Comprehension of Words, 
Poetry, Sentences, Paragraphs, and Longer Articles, and (c) 
Ability to Use Skills Required in Locating Information.” 

(4) Films for the Improvement of Reading.*— These sixteen 
films, consisting of selections taken from a national journal, are 
intended to make each student read as swiftly as he can com- 
prehend and no faster. This is done by projecting on the screen 
a printed page of film on which a broad band of light slides 
smoothly from left to right and from line to line. The student 
is not forced to stay within the band of more brightly lighted 
words but he is persuaded to attempt to follow this pacer. 
Comprehension check questions and transfer selections accom- 
pany the films. 
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PROCEDURE FOLLOWED IN THE READING LABORATORY 


Persons who enter the Reading Laboratory do so because of 
their own initiative or as a result of advisement. No one is 
compelled to enroll. The greater proportion of individuals begin 
their work during the first week of the semester. Students, how- 
ever, are permitted to enter any time if there is room in one of 
the sections. Each section is limited to twelve. 

At the first meeting the members of the group are given the 
Orientation Inventory to complete. Next they are shown how 
to score this inventory and how to prepare a profile sheet which 
is of value to both the student and the instructor in interpreting 
factors underlying the reading difficulty. 

During the next two meetings of the group Form Am of the 
Iowa Silent Reading Test is administered. The administration 
of this test requires approximately ten minutes of the third 
laboratory period. 'The remainder of the hour is spent in 
acquainting students with what has been accomplished by other 
people in the Reading Laboratory and an attempt is made to 
have them realize that they can improve their reading ability 
and at the same time facilitate their preparation for their regular 
college classes. The responsibility of learning to read is placed 
upon the student. 

During the fourth meeting of the group the results of the Iowa 
Silent Reading Test and the Profile Sheet for Orientation Inven- 
tory are interpreted and each person is given an opportunity to 
ask questions concerning his performance. Class discussion is 
encouraged at this time. If physical or emotional abnormalities 
are indicated by the Orientation Inventory, the services of the 
Health Service or Psycho-Educational Clinic are requested. 

The student is next asked to indicate on the Master Work Sheet 
the assignments upon which he needs to work in order to improve 
his reading ability. This Master Work Sheet is based upon the 
results of the Iowa Silent Reading Test and the Orientation 
Inventory. 

Each person then completes Assignment III at which time he 
and the laboratory clinician investigate visual defects which may 
interfere with reading ability. If significant visual difficulties 
are found, he is referred to an ophthalmologist. 

From this point on each individual is permitted to work upon 
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the assignments indicated on his Master Work Sheet. He is 
‘on his own.’ Seldom, if ever, do any two students have the 
same pattern of assignments. Each person is allowed to progress 
from assignment to assignment at his own rate and in accordance 
withhisown plan. Somemay spend days and even weeksupon one 
assignment while others may require much less time. The stu- 
dent, with the aid of the laboratory clinician, determines when heis 
ready for the next assignment indicated on his Master Work Sheet. 

Individuals in the Reading Laboratory are urged to apply the 
suggestions made in the laboratory to their outside study. Many 
apply the various assignments in their class preparation of history 
and English, while others use their textbooks in biology and 
chemistry as & means of increasing their reading abilities and 
skills. Adjustment of materials to the reading abilities of the 
students is essential and frequently becomes à real problem for the 
instructor. 

When the enrollee and the instructor agree that the purpose for 
which the student has entered the Laboratory has been accom- 
plished, Form Bm of the Iowa Silent Reading Test is adminis- 
tered. Changes between initial and final test scores are inter- 
preted and discussed. Many individuals continue two and even 
three semesters in the Laboratory. 


PROCEDURE USED IN MAKING THE EVALUATION 


1) Twenty college students enrolled in the Reading Laboratory 
were selected to make up the experimental group. 

2) The Iowa Silent Reading Test, Form Am, was administered. 

3) After a period of sixteen weeks an equivalent form of the 
Iowa Silent Reading Test was given to the twenty individuals 
enrolled in the Reading Laboratory. 

4) Data resulting from the administration of the Towa Silent 
Reading Test were tabulated and treated statistically. 

5) One control and one experimental group were equated. 
In equating the groups the individuals were matched according to 
sex, status in college, scholastic aptitude and ability in reading. 
The control group consists of twenty persons selected from the 
student body at large who have not had work in the Reading 
Laboratory, whereas the experimental group consists of twenty 
individuals who have been actively engaged in the work of the 
Reading Laboratory. Each of the two groups consists of fifteen 
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men and five women. Eleven individuals making up each group 
are freshmen, five are sophomores, two are juniors and two are 
seniors. For both groups the median score on the Ohio State 
Psychological Examination is 49.5 and on Part III of the same 
measure 59.5. The mean number of hours carried by each group 
was 15.2. Inspection of courses suggest that reading require- 
ments were approximately equal. 

6) The point-hour-ratios for one semester of the control and 
the experimental groups were tabulated and treated statistically. 

7) Data resulting from this study have been summarized and 
inferences have been tentatively set forth. 

8) In this study no attempt has been made to determine the 
permanency of gain in reading ability, whether or not there is an 
increased achievement in other language skills, and whether or 
not gain in reading achievement is accompanied by constructive 
personality changes. Future investigations could well be 
directed to an appraisal of these factors. 


TREATMENT OF DATA 


Data resulting from this study have been tabulated as shown 
in Tables 1 and 2. In order to determine the significance of the 
difference between the means obtained in the initial and final 
testing, the single group method of obtaining the standard error 
of the difference between correlated means of small samples was 
used and ‘t’ was found. In determining whether or not differ- 
ences between the experimental and control groups were sig- 
nificant, the standard error of the difference between two uncor- 
related means of small samples was found and “{? was calculated.” 


BRIEF HISTORY OF AN INDIVIDUAL WORKING 
IN THE READING LABORATORY 


Kenneth, who is eighteen years old, was graduated with a poor 
academic record from a large high school. Inability in reading 
was reported to be the chief cause of his poor school adjustment. 
However, corrective or remedial treatment in reading was not 
provided. After being refused permission to enter two mid- 
western colleges because of poor high-school grades, Kenneth 
sought the aid of the Psycho-Educational Clinic. The Wechsler- 
Bellevue Intelligence Scale revealed intelligence quotients of 
119, 116, and 121 on the verbal, performance and full scales, 
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respectively. Performance on the Iowa Silent Reading Test, 
Form Am, was equivalent to that of an individual eight months 
in the fifth grade (5.8). His percentiles on the Ohio State 
Psychological Examination and on the reading section of the 
same test were 23 and 20, respectively. The clinic suggested 
that Kenneth enter the Reading Laboratory at Western Michigan 
College where he also was permitted to enroll for fifteen hours of 
academic work. Assignments completed in the laboratory were 
those designed to develop skill in chapter reading, concentration, 
skimming, word study, use of the dictionary and skill in selecting 
essential facts for review. At the end of one semester his grade 
score on Form Bm of the Iowa Silent Reading Test was that of 
an individual five months in the tenth grade (10.5). This gain 
is statistically significant. In his academic work Kenneth 
earned three B’s and three C’s, which is equivalent to a point- 
hour-ratio of 1.4. He has enrolled for the second semester in the 
Reading Laboratory. ` 


TABLE 1.—ĪNITIAL AND FINAL Iowa SILenT READING TEST 
Scores оғ ALL STUDENTS IN THE EXPERIMENTAL GROUP 


Median Standard Score Initial Final 


200-204 5 
195-199 
190-194 
185-189 3 
180-184 5 
175-179 2 
170-174 
165-169 2 
160-164 1 
155-159 3 
150-154 3 
145-149 
140-144 1 


Total 20 20 

Mean 169.5 185.25 

Sigma 14.2 13.95 
Standard error of the difference of the two means is 1.12, 
“Р = 14.06. 
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SUMMARY OF DATA 


The distribution of initial and final scores of students enrolled 
in the Reading Laboratory on the Iowa Silent Reading Test is 
shown in Table 1. The correlation between equivalent forms 
was .94 and the degree of variability on both tests as indicated 
by sigmas of each distribution remained relatively constant. 

In Table 2 a distribution is shown of the point-hour-ratios of 
students who have been enrolled in the Reading Laboratory and 
an equivalent group of individuals who have not done corrective 
work in reading. Variability as determined by the sigmas of 
each distribution is comparatively constant. 


TABLE 2.—Pornt-Hour-Ratios or STUDENTS IN CONTROL AND 
EXPERIMENTAL Groups 


Point-Hour-Ratio Control Experimental 


.00 1 

.75-2.99 

.50-2.74 

.25-2.49 

00-2.24 2 

75-1.99 2 

.90-1.74 3 
3 
3 
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Total 20 20 
Mean LoL? 1.73 
Sigma 61 .605 
Standard error of the difference of the two means is .196, 
Р = 2.86. 


Tables 1 and 2 show that persons enrolled in the Reading 
Laboratory made not only a statistically significant gain in read- 
ing ability as measured by initial and final tests, but also sta- 
tistically higher point-hour-ratios than an equivalent group of 
students who were not enrolled in the laboratory. In both 
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tables the differences between the means are significant at the 


one per cent level. 
INFERENCES 


1) The data of this study show quite conclusively that students 
who enrolled in the Reading Laboratory not only made a marked 
and statistically significant gain in reading as measured by an 
objective test, but also made statistically significant higher 
point-hour-ratios than an equivalent group of students who did 
not do corrective work in reading. 

2) In consideration of the facts presented in this study it is 
reasonable to assume that the materials and procedures employed 
in the Reading Laboratory are of value in improving not only the 
reading ability of college students, but their point-hour-ratios as 
well. This, in part, may be due to the nature of the materials 
used in doing corrective work. The assignments have been 
directed primarily to the accomplishment of academic attain- 
ment and not merely to an increase in reading rate. 

3) It is reasonable to assume that mechanical instruments and 
techniques used to facilitate adequate eye movement are useful . 
adjuncts to the development of reading and study skills but that 
they cannot be regarded as sine qua non. 

4) Motivation is a factor to be considered in the interpretation 
of data presented in this study for each student entered the labor- 
atory voluntarily and not as à requirement. 

5) In interpreting data resulting from this evaluation consider- 
ation should be given to the possibility that some gain in achieve- 
ment may be due to the fact that students in the Reading Labora- 
tory have been singled out and given individual consideration and 


attention. 
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AWARENESS OF VOCABULARY SIZE: ITS 
RELATION TO CLASS STANDING AND 
SEX DIFFERENCES* 


JANICE LEVIN and CHALMERS L. STACEY 


Syracuse University 


INTRODUCTION 


To discover the extent of the difference between the amount 
of knowledge that we credit to ourselves and the amount we actu- 
ally possess is to discover our academic limitations and, not 
infrequently, the fact that we know more than we think we do in 
some respects and less in others, 

Any college class taking an examination can be divided into 
three groups on the basis of expected and obtained grade on that 
test. One group will be made up of students whose expected 
grades approximate their obtained grades. The other two 
groups will be composed of students whose obtained grades are, 
respectively, higher and lower than expected. Is there any rela- 
tionship between the students’ standing in the course and the 
deviation between expected and obtained grades? Does the 
better student possess greater awareness of the degree of his 
mastery of the essentials of the course than the poorer student? 
How does the average student compare in this respect with the 
twoextremes? Dosex differences play a rôle in such estimations? 

That personality factors play an important part in the estima- 
tion of one’s future performance has been shown in the many 
investigations of level of aspiration behavior. These factors 
have, of necessity, been neglected in this study. 

Bear and Odbert's! study of the ‘insight’ displayed by college 
students in evaluating their knowledge of word meanings led 
them to conclude that “the average student's statement is a very 
uncertain guide to his performance on a test.” Their two 
hundred eighty-two subjects indicated the words that they did 
not know in the material given them and were administered 
shortly afterward the vocabulary test from which the words were 
taken. The subjects missed sixty-four per cent of the words they 
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said they did not know and forty-four per cent of the words they 
claimed to know. 

It is the aim of this paper to study awareness of vocabulary size 
in relation to class standing and sex differences. 


DESIGN OF THE EXPERIMENT 


The subjects of this study were one hundred forty-three 
sophomore students, sixty-seven males and seventy-six females, 
enrolled in an introductory psychology course. In respect to 
the study of class standing, three groups were formed on the 
basis of the sum of the raw scores on four one-hour examinations 
during the semester: lower twenty-five per cent, thirty-six sub- 
jects; middle fifty per cent, seventy-one subjects; upper twenty- 
five per cent, thirty-six subjects. In the testing which followed, 
these groups were compared with each other and with the entire 
group in respect to the measures being considered. With the 
exception of a female student in the lower twenty-five per cent 
group, all subjects took the tests relevant to this study. In the 
course of the study of sex differences, the male, female, and entire 
groups were compared with each other on the measures under 
consideration. 

Development of the key.—Familiarity with words cannot justi- 
fiably be discussed in terms of a dichotomous relationship existing 
between knowing and not knowing the meanings of words. The 
continuum underlying word familiarity ranges from absolute 
unfamiliarity with the word to absolute certainty of its meaning. 
When subjects are forced to place words into ‘know’ and ‘don’t 
know’ categories, there is no way of determining how familiar 
they are with the words they say they know or how unfamiliar 
with the words they claim not to know. 

The familiarity of some words is beyond question. Some are 
more familiar in certain contexts than when by themselves or in 
other contexts. There are some words that we recognize and 
perhaps even use yet whose meanings are vague. Of the words 
whose meanings we do not know, there are some that we recog- 
nize and some that we cannot recall having seen or heard. These 
varying degrees of familiarity and strangeness of words, as dis- 
cussed by Bear and Odbert,! served as the basis for the key which 
was used by the subjects for the classification of the words and 
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phrases presented to them. The five items of the key were 
phrased as follows: 


1) I know this word (or phrase). I know what it means no matter 
where it may appear. 

2) This word (or phrase) is familiar to me. If it were used in a sen- 
tence, I would know what it means. 

3) I recognize this word (or phrase). I am not sure that its use in & 
sentence would help me to know what it means. 

4) I recognize this word (or phrase). I have no idea of its meaning. 

5) I have never seen or heard this word (or phrase). 


A Vocabulary Appraisal Shect.—The Michigan Vocabulary 
Profile Test served as the basis for the preliminary data sheet 
which was called ‘A Vocabulary Appraisal Sheet.’ This vocabu- 
lary test has eight subtests covering the fields of study and 
interest of students. In each of the subtests are thirty items 
arranged in order of increasing difficulty. The items either define 
or describe one of four words or phrases given. 

The last fifteen correct answers in seven subtests (the sports 
test was excluded) were listed on the appraisal sheet. Opposite 
each word or phrase were five boxes each of which represented 
one item of the key. The subjects were directed to familiarize 
themselves with the key items and the sample appraisal printed 
on the sheet and to express how well they felt they knew each 
word or phrase listed by placing an ‘X’ in the appropriate box 
next to each item. 

The vocabulary test was administered four weeks after the sub- 
jects had filled out the appraisal sheet. Raw scores on each 
of the subtests and a composite raw score were obtained for each 
subject. 

Combining key items.—On inspection of the item statements of 
the key, it will be noted that categories 1 and 2 indicate positive 
familiarity with the word; that is, within certain limits, the sub- 
ject would be expected to know those words placed in these 
categories. Category 3 implies that the subject is uncertain of 
his ability to define the word and may be considered an “uncer- 
tain’ category. Items 4 and 5 are statements of negative 
familiarity: one would expect that the subject would define 
correctly only that proportion of words placed in these categories 


that can be predicted on a chance basis. In view of the combi?" 


at 
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tive possibilities presented by the five-item key, three new cate- 
gories were evolved, the positive, uncertain and negative. 

The estimate scores are concrete demonstrations of awareness 
of vocabulary size. They represent the difference between 
estimation and performance. The positive estimate score is the 
difference between the number of words of those appraised which 
the subject claims to know and the number of words defined 
correctly on being tested. The negative estimate score is the 
number of words the subject says he does not know minus the 
number he fails to define on being tested. By definition, aware- 
ness of vocabulary size is a function of the estimate scores. 

The positive estimate score was obtained by subtracting from 
the total number of words placed by the subject in categories 1 
and 2, the total number defined correctly. A positive value 
of this measure indicates overestimation on the part of the 
subject of his ability to define the words presented. The nega- 
tive estimate score is the sum of words placed in categories 4 and 
5 minus the number missed. A positive value indicates that the 
subject has overestimated the number of words he would miss, 
or underestimated the size of his vocabulary in respect to these 
words. Positive and negative estimate scores were computed 
for each subject and averaged to yield group values. 


Srupy I: AWARENESS OF VOCABULARY SIZE AND CLASS STANDING 
AIMS OF THIS STUDY 


Defining awareness of vocabulary size as a funetion of the 
deviation between what the subject says he knows and what he 
knows on being tested, we may say that the subject who possesses 
greater awareness of his vocabulary size will define correctly à 
greater percentage of the words he claims to know than the sub- 
ject who is a poor judge. By the same token, one would expect 
him to overestimate and underestimate the number of words he 
knows or does not know to a smaller degree than the poorer judge. 

With a clearer understanding of the tools and techniques used, 
it is now possible to state the null hypotheses, the testing of 
which may be considered а restatement of the aims of this study. 

1) There is no difference between the three subgroups and 
entire group in respect to the mean percentage of correctly defined 


categorized words. 
2) There is no difference between the subgroups and entire 


178 The Journal of Educational Psychology 


group in tendency to overestimate or underestimate vocabulary 
size. 

3) The correlations between the total raw scores on the vocabu- 
lary test and the semester raw scores for the subgroups and entire 
group are zero. 

RESULTS AND DISCUSSION 


In Table 1a are presented the mean percentages of correctly de- 
fined words placed in the categories of the five-item key by thesub- 


TABLE lA.—MEAN PERCENTAGES or Correcr DEFINITIONS 
or Worps PLACED IN EACH or THE CATEGORIES OF THE 
Five-1rem KEY BY THE SUBGROUPS AND ENTIRE GROUP 


Category Lower 25% Middle 50% Upper 25% Entire group 


1 57.2 59.8 67.6 61.5 
2 46.0 41.8 52.1 46.6 
3 39.7 40.8 43.1 41.2 
4 29.0 32.3 41.5 34.3 
5 25.0 25.7 28.1 26.3 


groups and entire group. It will be noted that the upper group 
consistently defines a greater percentage of words correctly than 
the lower, middle, and entire groups. The middle group, with 
the exception of those words placed in category 2, defines a 
greater percentage of words than does the lower group. 

Of the words placed in category 1, words which the subjects 
said they would know under all circumstances, the lower group 
missed forty-three per cent; the middle group, forty per cent; the 
upper group thirty-two per cent, and the entire group missed 
thirty-eight per cent. In category 2, the lower group failed to 
define fifty-four per cent of the words they said they would know 
in context; the middle group, fifty-eight per cent; the upper 
group, forty-eight per cent; and the entire group fifty-three per 
cent. The lower group knew forty per cent of the words they 
placed in category 3; the middle group, forty-one per cent; the 
upper group, forty-three per cent ; and the entire group defined 
correctly forty-one per cent of the words of whose meanings they 
were unsure. Of the words placed in category 4, words which 
the subjects recognized but said they could not define, the per- 
centage of correct definitions for the lower group was twenty- 
nine; for the middle group, thirty-two; upper group, forty-two; 
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and entire group thirty-four. A chance percentage of correct 
definitions was obtained for the words placed in category 5 by 
the subgroups and entire group. 

Table 1b presents the mean percentages of correct definitions 
for the four groups in the categories of the three-item key. The 


TABLE 1B.—MEAN PERCENTAGES OF Correct DEFINITIONS OF 
Worps PLACED IN EACH OF THE CATEGORIES OF THE 
Turep-irem Key BY THE SUBGROUPS AND ENTIRE 


Group 
Category Lower 25% Middle 50% Upper 25% Entire group 
Positive 54.4 56.6 64.2 58.0 
Uncertain 39.7 40.8 43.1 41.2 
Negative 26.9 29.0 31.7 29.2 


upper group consistently defines a greater percentage of words 
correctly than the lower, middle, and entire groups. The middle 
group assumes an intermediate position in each category with 
respect to the other two subgroups. 

Critical ratios computed between the mean percentages of 
correct definitions in each category of the five- and three-item 
keys for the three subgroups and entire group yield no significant 
differences between them in respect to mean percentages of 
correctly defined categorized words. 

The estimate scores of the subgroups and entire group are pre- 
sented in Table 2a. As a whole, the groups overestimate the 


TABLE 24.—MxAN ESTIMATE SCORES, STANDARD Errors, AND 
RANGES OF THE THREE SUBGROUPS AND ENTIRE GROUP 


Estimate Lower Middle Upper Entire 
Scores Measures 25% 50% 25% Group 
Mean S.E. 18.1 1.7 17.4 1.2 9.8 1.7 15.7 .89 
Positive Range 0 to 43 6 40 38  —13to028  —13to 43 
Mean S.E. —27.7 1.7 —29.0 1.3 —21.7 1.4 —26.8 .90 
Negative Range —52 to —10 —61to —2  —40 to 0 —61 to 0 


number of words they know in respect to both positive and nega- 
tive estimate scores. The lower group presents evidence of 
greater overestimation of vocabulary size than does the middle 
group: this group, in turn, presents a greater deviation than the 
upper group. 'The negative estimate scores indicate that the 
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greatest underestimation of unknown words occurs in the middle 
group, while both the lower and upper groups underestimate less. 


groups, it will be noted that with rise in class standing the sub- 
jects tend to become more conservative in their estimations of 
vocabulary size. 

In Table 2b are presented the critical ratios obtaining between 
the estimate scores of the subgroups and entire group. At the 


е On inspection of the ranges of the estimate scores for the sub- 


TABLE 2n.—CnrrICAL Ratios OBTAINING BETWEEN THE MEAN 
ESTIMATE Scores OF THE THREE SUBGROUPS AND ENTIRE 
Group 
Critical Ratios 

Land M LandU Land E Mand U Mand E U and E 


Positive .89 3.46 1.26 3.64 1.14 3.06 
Negative .60 2.73 .46 3.80 1.38 3.07 


one per cent level, the differences between the upper group and 
the lower, middle, and entire groups are significant for both 
positive and negative estimate scores. In other words, while all 
groups tend to overestimate the number of words they knew, the 
upper group does so to a significantly smaller degree than the 
others. 

Correlations between semester raw scores and vocabulary test 
Scores are presented in Table 3. The values of ‘t’ were com- 


TABLE 3.—CorRRELATIONS OBTAINING BETWEEN SEMESTER RAW 
SCORES AND VOCABULARY TEST SCORES FOR THE SUBGROUPS 
AND ENTIRE Group 


Group r S.E. t А 
Lower 25% .02 «11 .12 
Middle 50% .28 ll 2.42 
Upper 25% .07 АЛ 41 
Entire Gr. .99 .07 5.03 


puted to test whether the obtained coefficients differed sig- 
nificantly from zero. The t-values yielded indicate that the 
correlations obtained for the lower and upper groups are not 
significantly different from zero, while the r-values of the middle 
and entire groups are significant at the two and one per cent 
levels. 


ац: 
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CONCLUSIONS 


1) The null hypothesis of equality of mean percentages of 
correctly defined words placed in the categories of the three- and 
five-item keys by the subgroups and entire group is not untenable 
with the data presented. One would therefore fail to reject the 
null hypothesis. However, despite the fact that the differences 
obtaining between the values of the measure for the different 
groups are not statistically significant, there is a consistent 
trend present in the direction of greater awareness of vocabulary 
size with rise in class standing. 

2) The null hypothesis of equality of positive and negative 
estimate scores for the subgroups and entire group is rejected at 
the one per cent level. The upper group underestimates and 
overestimates to а significantly smaller degree than the lower, 
middle, and entire groups. Since awareness of vocabulary size 
has been defined as a function of the estimate scores, one may 
conclude that the upper group possesses a greater awareness of 
the size of its vocabulary than the other groups. The tendency 
of the middle group to manifest greater awareness of the size of 
its vocabulary than the lower group is present but not consistent. 

3) On the basis of t-values presented, the null hypothesis of 
zero correlation between semester raw scores and vocabulary 
test scores is rejected at the two and the one per cent levels for 
the middle and entire groups. There is a trend in the direction 
of larger vocabulary size with rise in class standing. 

4) In view of the data presented, one may conclude that as 
class standing rises, i.e., in rising from lower to middle to upper 
achievement groups in this group of subjects, greater awareness 
of vocabulary size is manifested. 


Srupy Il: AWARENESS OF VOCABULARY SIZE AND 
Sex DIFFERENCES 


AIMS OF THIS STUDY 


Awareness of vocabulary size, defined as a function of the 
deviation between estimated and obtained scores in a testing 
situation, has been found to be possessed by students to a remark- 
ably small degree. It has been shown that, irrespective of class 
standing and vocabulary size, students in general tend to over- 
estimate the number of words they know. 
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It is the aim of this paper to determine whether this poor 
judgment can be explained on the basis of sex differences in esti- 
mation of vocabulary size. The null hypotheses to be tested 
are the following: 

1) There is no difference between males and females in mean 
percentages of correctly defined words placed in the categories 
of the three- and five-item keys of word familiarity. 

2) There is no difference between males and females in respect 
to overestimation and underestimation of vocabulary size. 


RESULTS AND DISCUSSION 
Mean percentages of correctly defined categorized words.—In 


Table 4a are presented the mean percentages of correctly defined 


TABLE 44.—Muan PERCENTAGES or Correcr DEFINITIONS OF 
Worps PLACED IN THE CATEGORIES or THE Frve-1rem KEY 
BY THE MALE, FEMALE, AND ENTIRE GROUPS 


Category Male Female Entire Group 
1 63.2 59.4 61.3 
2 48.5 44.9 46.7 
3 44.2 38.4 41.3 
4 36.4 31.8 34.1 
5 27.0 25.3 26.2 


words placed in the categories of the five-item key by the male, 
female, and entire groups. The male group consistently defines 
a greater percentage of words than the female and entire groups. 
The entire group assumes an intermediate position in each 
category with respect to the male and female groups. 

Of the words placed in category 1 of the five-item key; the males 
failed to define correctly thirty-seven per cent of the words, the 
females missed forty-one per cent, and the entire group missed 
thirty-nine per cent. The males failed to define fifty-two per 
cent of the words placed in category 2; the females, fifty-five per 
cent; and the entire group, fifty-three per cent. The males knew 
forty-four per cent of the words placed in category 3, the females 
knew thirty-eight per cent, and the entire group knew forty-one 
per cent. Of the words placed in category 4, the males knew 
thirty-six per cent; the females, thirty-two per cent; and the 
entire group, thirty-four per cent. A chance percentage of 
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correct definitions of those words placed in category 5 was 
obtained for each of the groups. 

Table 4b presents the mean percentages of correct definitions 
of words placed in the categories of the three-item key by the 


TABLE 4в.—МЕАХ PERCENTAGES OF CORRECTLY DEFINED 
Worps PLACED IN THE CATEGORIES OF THE THREE-ITEM 
KEY py THE MALE, FEMALE, AND ENTIRE Gnours 


Category Male Female Entire Group 
Positive 59.6 56.5 58.0 
Uncertain 44.2 38.4 41.8 
Negative 31.0 27.6 29.2 


male, female, and entire groups. The males consistently define 
a greater percentage of words correctly than the entire group 
which, in turn, consistently defines a greater percentage of words 
than the female group. 

Critical ratios computed between the three groups for each 
category of the three- and five-item keys yield no significant 
differences either between the sexes or between the entire group 
and the sex groups. 

The estimate scores of the male, female, and entire groups are 
presented in Table 5. As a whole, the groups overestimate the 


TABLE 5.—Mean ESTIMATE Scores, STANDARD ERRORS, AND 
RANGES OF THE MALE, FEMALE, AND ENTIRE GROUPS 


Entire 
Score Measure Male Female Group 
Mean S.E. 16.4 1.2 15.0 1.3 15.7 .89 
Positive Range 151043 —13to38  —13 to 43 
Mean S.E. —27.4 1.3 —26.4 1.2 —26.8 .90 
Negative Range —3to —61 Oto—5l Oto —61 


number of words they know in respect to both positive and nega- 
tive estimate scores. The female group consistently overesti- 
mates less than the male and entire groups. The male group 
consistently overestimates to a greater degree than the entire 
group. Critical ratios computed between the estimate scores of 
the three groups yield no significant differences in respect to sex 
differences in overestimation of vocabulary size. 
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CONCLUSIONS 


1) The null hypothesis of equality of mean percentages of 
correctly defined words placed in the categories of the three- and 
five-item keys by the male, female, and entire groups is not 
untenable with the data presented. Although the males define 
correctly a greater percentage of categorized words than the 
female and entire groups, the differences observed are not statisti- 
cally significant. 

2) The null hypothesis of equality of estimate scores of male 
and female groups is not rejected. The males overestimate the 
number of words they know and underestimate the number they 
do not know to a greater, although not statistically significant, 
degree than the female and entire groups. 

3) On the basis of the data presented, one must conclude that 
in this group of students, sex differences cannot account for the 
lack of awareness displayed by college students in respect to 
vocabulary size. 
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SOME COMMENTS CONCERNING THE ROLE OF 
EDUCATION IN THE *CREATION 
OF CREATION”? 


EDITH A. WEISSKOPF 


Department of Psychology 
Purdue University 


Most people would agree that it is one of the main aims of 
education to encourage the development of creative abilities. 
Therefore, educators are forced to concern themselves with the 
following question: What are the conditions which enhance the 
formation of creative thought? The literature in psychology and 
related fields contains a considerable amount of information 
about creative thought and the conditions of its growth. This 
information is based on general impression, on the analysis of 
biographical data, on introspective statements of creative think- 
ers, or on experimental research. In spite of the diversity of its 
origin the literature shows a considerable amount of agreement 
as to some of the conditions enhancing creativity. Thus, one 
would expect educators to use techniques in their intellectual 
work similar to the techniques which are thought to create a 
fertile soil for the growth of new ideas. 

Strangely enough this is not often the case. It is the objective 
of this paper to discuss some specific aspects of the well-known 
fact that the mental attitude during intellectual work encouraged 
by our schools is in many respects diametrically opposed to the 
mental attitude which is thought to stimulate creativity.” 8 

Most educators in their oral or written admonitions to their 
pupils stress the importance of industry. Yet, if we scan through 
the literature on creativity, we find statements such as the follow- 
ing: “ . . . though without industry great intellectual work can 
not be done, yet mere industry may prevent creation”?! (p. 149). 
Educators emphatically stress the first part of this statement 
when teaching students, but are, with few exceptions (e.g.!?), 
reluctant even to mention the second part. The constant activ- 
ity enforced by many educators does not give young people the 


1 A paper presented at the Annual Meeting of the American Psychological 
Association, September, 1950. 
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leisure which is an essential prerequisite for intellectual or artistic 
creation.?.!$ 

We teach our pupils the importance of regular study habits. 
Why do we ignore statements such as the following? “Тһе 
advantage of regular habits during the student years is great; but 
the optimum point at which the curve of that advantage cuts the 
curve of the advantage of fresh initiative is different for those 
whose professional work will be intellectual origination, and for 
those of different powers and aims’ (p. 297). If pupils would 
use the explicit admonitions received from their teachers as their 
only source of knowledge on study techniques, it would never 
occur to them that regular study habits could be anything but 
advantageous. 

We try to instill a critical attitude towards intellectual matters 
in our students, but Hutchinson quotes a scientist saying: 
"It is surprising how fertile the mind becomes when not 
interrupted, or restricted by criticism in the free and often 
fantastic expression of its ideas"* (p. 32). 

Our school system stresses the importance of intellectual objec- 
tivity and the liabilities of one-sidedness. Thus,“ . . . students 
often start their careers with some intense enthusiasm, then 
learn in college how narrow and ‘immature’ it is, how much can 
be said on the other side, and how many other good ways of doing 
things exist. They gradually acquire a spirit of mellow tolerance 
and scholarly insight, but lose the creative impulse?! (p. 301). 

It is challenging to examine in this connection suggestions made 
by psychiatrists or clinical psychologists on the mental attitude 
which leads to optimal results in producing insight and under- 
standing with regard to their patients’ problems. Freud, for 
example, makesthe following recommendations on treatment tech- 
niques: “АП conscious exertion is to be withheld from the capac- 
ity for attention . . . "*(p.324). “One hassimply to listen and 
not to trouble to keep in mind anything in particular” (p. 325). 
“Tt is not a good thing to formulate a case scientifically while 
treatment is proceeding, to reconstruct its development, antici- 
pate its progress, and take notes from time to time of the condition 

at the moment, as scientific interest would require" (p. 326-7). 
* | , , the most successful cases are those in which one proceeds, 
as it were, aimlessly, and allows oneself to be overtaken by апу 
surprises, always presenting to them an open mind, free from 
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expectation” (p. 327). Reik also emphasizes the liabilities of 
continuous sharp attention and the benefits of inattentive states: 
«о. training in attention may succeed “too well,” so that the 
child is shut off from a whole flood of freely emerging associations 
and ideas"! (р. 165). “Тһе concentration of attention involves 
a setting up of inhibitions, so that keen observation of particular 
things corresponds to the ignoring of others. Withdrawal of 
certain contents from consciousness is no less a part of attention 
than the appearance of others at the center. It is open to ques- 
tions which part is the more significant to the essence and action 
of attention, the illumination of particular objects, the bestowal 
of intensive interest upon them, or its diversion away from 
others" (p. 164). “Not until I cast off the customary restraint 
of voluntary attention was I able to get hold of the hidden psy- 
chical data. Not until I left the firm and broad high road did I 
reach the goal along side paths. The secret meaning escaped my 
conscious, active attention, and was not found until I had become 
Gnattentive’ in the popular meaning of the word, that is, until I 
gave myself up to unconscious ideas of the goal” (p. 169). 

If a student would show a mental attitude towards his school 
work similar to the one advocated by these clinicians, he would 
elicit the serious criticism of his teachers. The objection may be 
raised that intellectual work of the academic type is basically 
different from the achieving of insight into the personality prob- 
lems of a neurotic patient, and that it, therefore, requires a differ- 
ent mental attitude. Quite true. Yet the literature on creative 
thought suggests that Freud’s admonitions may prove useful in 
any situation where insight is required. Moreover, Maier and 
Luchins show that the arriving at solutions of various kinds of 
problems is facilitated by such ‘loosening’ instructions as ‘‘Do 
not be a creature of habit and stay in a rut,” “ Кеер your mind 
open for new meanings,” “The solution pattern appears suddenly. 
You cannot force it”? (p. 147), or “Don’t be blind? (p. 2). 

Thus, educators may find it profitable to advocate a passive, 
inattentive attitude to their students not as a permanent condi- 
tion but as a stimulating technique during specific phases of their 
intellectual work. As Bateson states “ . . . the advances in 
scientific thought come from a combination of loose and strict 
thinking, and this combination is the most precious tool of 
Science"! (p. 55). 
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At this point I expect some readers to voice objections. ‘‘Indus- 
try, regular study habits, a critical, controlled attitude, are 
necessary attributes of successful intellectual work,” they will 
say. ''The creative individuals who found that relaxation, 
irregular habits, and temporary abandonment of criticism and 
control enhance creativity have spent years of strenuous prepara- 
tion during which they exercised all the virtues advocated by 
traditional educators.” Quite true. Yet the question remains 
unanswered why, among the four stages of the creative process, 
namely, preparation, incubation, illumination, and verifica- 
tion*—7.12-16.18 we prepare children for the first and last stage only, 
and completely ignore the other two stages. Only one possible 
cause of this educational bias will be suggested in this paper. 

The process of insight and illumination appears to be directed 
by unconscious forces to a higher degree than the process of 
preparation and verification. Just as lightning represents the 
sudden explosive merging of positive and negative electricity, 
intellectual insight may represent the sudden merging of con- 
scious content accumulated during the stage of preparation with 
unconscious, repressed material. "Thus, it may be the denial of 
this repressed material which causes educators to deny the process 
of illumination. In other words, we do not want to accept the 
fact that intellectual activity takes part of its energy supply 
from the big reservoir of unacceptable impulses called the Id, 
that the material carefully and rationally accumulated during 
the period of preparation has to become imbued with Id-impulses 
in order to be brought to life. We falsely admonish our students 
to exert control in order to keep these impulses repressed instead 
of teaching them to make their impulses subservient to intel- 
lectual activity. 

Just as we often deceive small children about the nature of 
biological creation, we deceive older children by pretending that 

intellectual creation is unemotional. Thus, by de-emotionalizing 
intellectuality and by keeping the ‘sweet secret’ of intellectual 
creation from youth, we suffocate intellectual creativity. 
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BOOK REVIEWS 


Cerra B. SrENDLER. Children of Brasstown. Urbana, Illinois: 
Bureau of Research and Service of the College of Education, 
University of Illinois, 1949, pp. 103. 


This monograph is primarily concerned with the awareness of 
‘social class’ and class symbols of first-, fourth-, sixth- and eighth- 
grade children in one school in a New England industrial town of 
15,000 inhabitants. 

The author identified four classes in the community ‘by inter- 
views with townspeople.’ Unfortunately, we are not told how 
many people were interviewed, how they were selected, nor which 
‘classes’ they represent. The one hundred seven children in the 
study were then rated by five adult judges as belonging to the 
upper middle, ‘white collar,’ or working class. An upper class 
category was not used by the judges since it was presumed that 
upper class children did not attend publie schools. There seems 
to be a class bias in the ratings since none of the judges repre- 
sented the working class. Further, in discussing the ‘social 
classes’ the author sometimes refers to them as socio-economic 
categories and at other times as prestige categories. It is unfor- 
tunate that more rigorous procedures were not used in stratifying 
the community and in class placement of the children, for the 
remainder of the research is carefully designed. 

The children were interviewed in regard to their out-of-school 

* activities and their friendship choices. They were asked to 
rate four sets of pictures representing class differentials in jobs, 
houses, clothing and recreation. In addition, they rated their 
own and classmates’ ‘social class’ position and answered a ‘guess 
who’ test. Some of the major substantive conclusions were: 
(1) the higher the grade in general the greater the awareness of 
class symbols; (2) in the lower grades, boys are more discerning 
in awareness of class symbols and in the higher grades girls seem 
to be more discerning; (3) the higher one’s class placement, the 
more conscious one is of class symbols; (4) out-of-school activities 
such as work activities and music and dancing lessons are con- 
ditioned by class placement of parents; (5) in-school choices are 
more democratic than out-school choices in friendship selections; 
(6) the higher the grade, the greater the awareness of class posi- 
tion of schoolmates and the greater the awareness of class as 
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revealed in future occupational choice. Miss Stendler also offers 
certain generalizations applying to all class levels and sets up 
four levels of awareness of class symbols. 

In the final chapter the author discusses the implications of her 
findings. She raises some trenchant questions regarding the 
unrealism of typical social studies programs in the primary grades 
and the proposed solutions of Allison Davis and others to the 
lower class child’s anxiety over loss of prestige. Educational 
psychologists and school administrators will find this chapter 
exceedingly provocative. 

This reviewer was somewhat dissatisfied with the omission of 
supporting tables and statistical analyses for certain conclusions. 
One would like to be able to judge for oneself, for example, the 
significance of the analysis of variance tests rather than accept 
the author’s judgments without supporting data that certain 
relationships are statistically significant (p. 53). Near Gross 
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E. G. WiLnLraws, Editor. Trends in Student Personnel Work. 
Minneapolis: University of Minnesota Press, 1949, pp. 417. 


This book presents forty-three papers by nearly as many 
Authorities, read at the University of Minnesota in connection 
With a three-day meeting of ''associates in personnel work" 
from various institutions of higher education. The papers 
Present (1) an overview of student personnel work during the 
last quarter century, (2) some of the difficulties encountered 
along the way, and (3) points up current best practices, covering 
research on methods, tests, counseling techniques and therapeutic 
procedures. This book can be read with interest and profit 
both by students and workers. ‘‘The papers outline the growing 
edge of student personnel work." It should be particularly 
helpful to anyone—student or professor—wishing to gain 
acquaintance with the field both as to present status and future 
Promise. 

The broad scope of the papers may be seen from the following 
listing of the main divisions of the book (contributors to each 
division are also here listed): Part I, The Réle of Personnel Work 
in Higher Education (M. M. Willey, W. H. Cowley, M. 8. 
MacLean and H. Y. McClusky). Part II, Developments in 
Tests and Testing (J. G. Darley and D. B. Stuit). Part III, 
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Voeational Counseling and Occupational Adjustment CD. G: 


- Paterson and C. L. Shartle). Part IV, Counseling Methods and 


Points of View (E. 8. Bordin, E. Н. Porter, Jr.). Part V, Mental 
Hygiene (R. G. Hinckley, R. F. Berdie and Mrs. Anne Fenlason). 
Part VI, Problems of Student Veterans (Б. J. Strom and S. J. 
Wenberg). Part VII, Special Personnel Services (F. G. Moore, 
Mrs. Dorothy Dyer, W. C. Stevens, Mrs. Margaret Aldrich, 
J. D. Foley, Bryng Bryngelson, G. B. Risty, Ruth E. Boynton). 
Part VIII, The Róle of Student Housing in Education (B. J. 
Borreson, A. H. Drammen). Part IX, Personnel Work as a 
Profession (Esther Lloyd-Jones, C. G. Wrenn and J. G. Darley). 
Part X, Counseling by Faculty Members (D. D. Feder, W. M. 
Gilbert, D. J. Shank and J. L. Bergstresser) Part XI, Religious 
Programs and Student Personnel Work (E. G. Williamson, Rev. 
James Boren, Rabbi Norman Frimer, Father Leonard Cowley). 
Part XII, Social Adjustment through Activities (W. H. Cowley, 
R. L. Sutherland). Part XIII, Personnel Problems of Women 
(Kate Hevner Mueller, Esther Lloyd-J ones). Part XIV, Testing 
and the Curriculum (C. P. Turner, R. ЦА Tyler). 


J. B. Stroup 
State University of Iowa 
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E" COMMUNITY VARIABLES AS PREDICTORS OF 
INTELLIGENCE AND ACADEMIC 
N ACHIEVEMENT 


м ROBERT І. THORNDIKE 


Teachers College, Columbia University 


In 1939 E. L. Thorndike? reported the results of a detailed 
Statistical investigation of the facts about American cities which 
Serve to predict the extent to which a city provides a good life 
for its inhabitants. The criterion of the good life in this research 
Was a rationally weighted composite of measures of the health, 
Sa education, comfort, etc. of the population. He studied the 
| relationship of the index of ‘general goodness’ to an index of com- 

munity wealth and one representing the quality of the popu- 
lation. On the basis of the correlation between these indices, he 
concluded that ‘general goodness’ was more directly a function 
of the qualities of the people in the community than it was of ~ 
community wealth, and that personal qualities and wealth in + 
Combination accounted for most of the predictable ‘goodness’ 
of the community. p 
d Even before this time Maller,? studying districts in New York 
à City, had found a substantial relationship to exist between school 
acceleration and community variables. He reported a multiple 
Correlation of .81 between a composite of six economic and health 
Variables and the index of school acceleration. 

Thorndike and Woodyard! followed up Thorndike’s original 
study with a project to test the children in a sample of cities 
and studied the relationship between community variables and 
Performance on a standardized intelligence test. The National 
Intelligence Test was administered to all sixth-grade children in 
thirty small cities. On the basis of these data, estimates were 
N made of the correlation between N.I.T. score and the indices of E. 
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general goodness, personal qualities of the population and per 
capita income. It was estimated that the correlations were, 
respectively, .86, .82, and .78. 

In none of these early studies were objective measures of 
intelligence or achievement available for any substantial number 
of communities. The gathering of test data on such a large scale 
merely for a research project would, of course, have been pro- 
hibitively expensive. It is only as data have become available 
from large scale testing or test standardization projects that 
studies of the relationship of community variables to measured 
intelligence or achievement have become possible. The present 
analysis is based upon the testing carried out in 1945 to stand- 
ardize revised forms of the Metropolitan Achievement Test. 
The study of relationships between community characteristics 
and the measured intelligence and school achievement of the 
children in the community seemed both of theoretical interest in 
describing some of the sociological concomitants of ability and 
achievement, and of possible practical value in guiding the 
selection of communities for possible future enterprises of test 
standardization. Р 


Since the present study was undertaken, а report has been 


published by Davenport and Remmers! describing relationships . 


between social and economic variables for states and the average 
performance of young men from those states on the A-12 and 
V-12 qualifying examination. The group taking the test were 
young men in high school or college trying to qualify for this 
World War II educational program, but the exact nature of the 
group, or the degree to which it represented a select fraction of the 
population of that age in the different states can hardly be deter- 
mined. Davenport and Remmers studied twelve predictors in 
relation to the test scores, and found substantial correlations for 
ten of them. The highest correlations were: 


Number of telephones per 1000 population 83 
Per capita income .81 
Value of school property .16 


On the basis of a factor analysis of the test scores and the pre- 
dictor variables, the authors conclude that an economic factor 
accounts for the bulk of the variation in test achievement. 
Certainly, the most predictive variables have an economic 
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flavor, though the extent to which the economic component is 
cause and the extent to which it is symptom of underlying popu- 
lation characteristics can hardly be determined from a statistical 
analysis of this limited number of variables. 


SOURCES OF DATA 


Data required for the present study were of two types. In the 
first place, it was necessary to have measures of the level of 
intellectual ability and scholastic achievement for each com- 
munity. These measures were obtained from the nation-wide 
testing that was carried out by the World Book Company as 
part of the program of establishing norms for the revised forms 
of the Metropolitan Achievement Test. In the second place, it 
was necessary to have a variety of educational, economic and 
sociological facts about each community for which test data were 
available. These were obtained from the reports of the 1940 
census. The nature of these data and the way in which they 
were prepared for analysis will be discussed in some detail. 

As indicated, intelligence and achievement test data were 
obtained from the standardization testing to provide norms for 
the revised form of the Metropolitan Achievement Test. These 
were supplied to the author by the World Book Company.* The 
standardization testing was carried out in October, 1945. The 
selection of communities in which to test was necessarily based in 
part on the willingness of the community to codperate. How- 
ever, through its regional agents the World Book Company was 
able to obtain communities spread over the whole United States, 
and test returns were received from at least one community in 
each state. Communities ranged in size from New York City, 
Oakland, Providence and Atlanta, where testing was carried out 
in a selected sample of schools, down to many communities with 
populations of under 2500. In addition, a number of county 
school systems were included, thus giving coverage of rural as well 
aš urban areas. In all, something in the neighborhood of 500,000 
children were tested, spread over some three hundred adminis- 
trative school units. 

* Т wish to acknowledge my debt to the World Book Company for these 
materials, and particularly to Dr. Walter Durost, at that time Director of 
the Division of Test Research and Service, who called my attention to them 
and went to some pains to make them available to me. 
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For a school system to be accepted as a participant in the 
standardization program, it had to undertake to test all the 
children in at least three adjacent school grades. Many, how- 
ever, tested over a wider grade span, and some tested in all 
grades from II through IX. The only exception to complete 
testing was in a few of the largest cities. In these cities, testing 
was carried out in certain selected Schools, chosen by an adminis- 
trator of the system as being representative of the schools of 
the community as à whole. All testing was carried out at nearly 
the same time of year, i.e., during October. Original scoring of 
the test blanks was carried out by the coóperating school systems. 
However, approximately a twenty per cent sample of test papers 
was returned to the World Book Company for check Scoring. A 
sample was selected at random from all the papers in a given 
class, following procedures specified by the publisher. The 
papers which were returned to the publisher and rescored were 
the ones used for establishing test norms, and are the ones which 
provide the data for this study. In specifying the sample to 
be returned to them, the publishers called for a minimum of six 
papers from each class, no matter how small the class. With 
small classes the per cent returned was well over twenty, but 
with larger classes the returns were held to twenty per cent. 

The testing program involved giving each class an appropriate 
form of the Metropolitan Achievement Test and an appropriate 
level of the Pintner Intelligence Tests, Verbal Series. The 
forms which were given to the different grades are as follows: 


Grade Intelligence Test Achievement Battery 

2 Pintner-Cunningham Primary Primary I 

3 Pintner-Durost (Picture Seale) Primary II 

4 Pintner-Durost (Reading Scale) Elementary 

5 Pintner Intermediate Elementary 

6  Pintner Intermediate Intermediate 

7 Pintner Intermediate Intermediate 

8  Pintner Intermediate Advanced 

9  Pintner Intermediate Advanced 


At the time the analyses reported in this study were under- 
taken, all tests had been scored and all raw scores had been 
expressed as derived or norm scores. Since the concern in this 

study was not to be with individual children, but rather with 
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individual communities, data made available for an analysis 
were averages. Average IQ was reported in the case of the 
intelligence test and average standard score in the case of each 
subtest of the achievement battery for each grade level in each 
community. 

Given data as indicated above for each separate grade group, 
it was necessary to consolidate them into a single intelligence 
index and a single achievement index to represent a given com- 
munity. Inthe case of the intelligence test, this was very simple. 
Since the type of IQ reported for the Pintner tests is essentially 
а standard score, with approximately the same mean and stand- 
ard deviation at different age levels, it was possible to combine 
data from different grades directly into a single average IQ. No 
attempt was made to take account of differences in the number 
of cases in different grade groups from a single community. 
These tended to be small in any case, and need not have cor- 
responded too closely to total numbers in the different grades in 
the community. There seemed little reason to think that they 
would give a better index for the community than a single 
unweighted average, and so the unweighted average of the sepa- 
rate grade averages was used. This provided a single index of 
level of intelligence for the children of the community. 

Obtaining a single achievement index for each community 
Was somewhat more indirect and laborious. The grade averages 
which were available were for each subtest separately, and they 
were expressed in terms of a single scale of converted scores. 
The publishers of the Metropolitan Achievement Test have 
provided conversion tables for translating raw scores on each 
subtest into standard scores which are anchored to the sixth- 
grade group. The sixth-grade mean is defined as 200 and the 
standard deviation is 20. By anchoring all levels of the test for 
all grades to this reference point, they have tried to facilitate 
comparisons between different forms and different subtests. 
The average standard score for a grade group is not directly 
interpretable as a measure of degree of excellence for the group, 
or of its deviation from all groups of the same grade. For- 
tunately, the publishers had also developed percentile norms for 
each grade, by means of which it was possible to translate a 
given standard score into a percentile value for that grade. If 


the assumption of a normal distribution is made, these m" 
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can in turn be translated into normalized standard score values 
expressing in more nearly equal units the degree of excellence of a 
particular score relative to its particular grade group. Standard 
scores with a mean of 50 and a standard deviation of 20 were 
used. Thus, a particular fourth-grade class group is found to 
have an average standard score on the arithmetic problems test 
of 170. This falls at the 70th percentile for fourth-grade children, 
and becomes a scale score of 60. The scale score designates the 
degree of excellence of that fourth-grade class as far as the meas- 
ure of arithmetical reasoning is concerned. 

The first step, then, was to translate the score of each grade 
group on each subtest into the corresponding scale score, repre- 
senting degree of excellence based on the performance of all 
children of that grade level. The next problem was what to 
do with the results of the several subtests, numbering from four 
to ten depending upon the grade level. One possible procedure 
would have been to keep the subtests separate and to study the 
background factors as predictors of success in each separate 
area of achievement. This possibility was rejected for the 
initial analysis. It was felt desirable first of all to get a general 
picture of the factors related to achievement. The scale scores 


_from the separate subtests were, therefore, combined into а 


single score. 

In combining the subtests, the problem was encountered of 
how to weight the different content areas. This was brought to 
the fore by the fact that in certain areas, notably arithmetic 
and reading, there were more than one subtest. Also certain 
areas appeared for all grades while others, such as science and 
history, were included only in the test for the higher grades. The 
procedure which was finally adopted was to weight each sub- 
test equally in computing an average scale score for each grade 
group, and then to weight each grade group equally in computing 
an average scale score for each community. Thus equal weight 
was given to a second-grade group and to an eighth-grade group; 
though the average was based on four subtests in one case and 
ten in the other. The final decision was based on the premises 
(a) that the allocation of number of subtests to an area at 9 
given grade level represented the best judgment of the makers of 
the test and might well be followed and (b) that each grade's 


„performance has equal significance in appraising the performance 
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of the community as a whole. The net effect of this decision 
was to give relatively heavy weight to reading and arithmetic 
and relatively light weight to the content areas in the over-all 
score for a community. 

In summary, then, the single achievement index was an 
average scale score. It was obtained by averaging the average 
Scale scores for the ѕерат: ќе grades in the community, weighting 
each grade equally. The grade average scale score was obtained 
by averaging the grade normalized scale scores for the several 
subtests. The subtest scores were obtained by using the table 
of percentile norms which related the universal standard scores 
for the subtest to percentiles for the particular grade. 

After the operations which have been described had been 
carried out there were available for each community an average 
IQ and an average achievement scale score. With respect to 
the achievement scores, however, one additional problem pre- 
Sented itself. It seemed altogether likely that different com- 
munities differed considerably as to the age of the pupils in & 
Eiven grade. Since achievement should be expected to be a 
function of age as well as of grade reached, it was necessary to 
take account of this fact. Accordingly, tabulations were made 
of the average age of pupils in each grade for each community. 
Distributions were prepared for all communities reporting data 
for a given grade, and the mean age and standard deviation of 
ages was determined for that grade. The values for the indi- 
vidual communities were converted into standard scores. The 
Standard scores for the several grades in a community were 
averaged to yield an average age index for the community. This 
age index made it possible to hold age constant when reporting 
Correlations with the achievement index. 

Facts about the communities included in the study were taken 
from the reports of the 1940 census. The analysis was restricted 
to facts available in the 1940 census because of their availability 
In standard form for all communities of a given size and type 
throughout the country. Availability was of some importance 
to the experimenter in carrying out this study. It would be 
even more important in any use of the results of this study by 
another worker in order to select communities for norming a new 
test or in order to interpret the achievement of a particular com- 
munity in which he was interested, Representative data of a 
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variety. of types were chosen, covering aspects of population 
structure, educational level, occupational distribution, housing 
conditions, and economic level. The choice of specific variables 
was admittedly somewhat arbitrary. It was limited to a con- 
siderable extent by what was available in published census 
reports. Within those limits the further choice represented the 
judgment of the experimenter as to which seemed meaningful 
and fruitful to explore. There are many other variables which 
might have been included and which it may prove fruitful to 
explore in a later study. 

The variables which were studied as predictors of intelligence 
and achievement are listed below. Each variable is defined 
sufficiently precisely for it to be reproduced by the reader. 


PREDICTOR VARIABLES 


Population. (Variable 1) Population in thousands, as given 
in the 1940 census. 

Per cent Native-born White. (Variable 2) This variable was 
obtained by dividing the number of native-born white by the 
total population. 

Per cent Under 5 Years Old. (Variable 3) Census figures for 
the number under five years were divided by the total population. 

Per cent Over 21 Years Old. (Variable 4) Census figures for 
the number over twenty-one were divided by the number in the 
total population. 

Median Grade Reached by Adult Population. (Variable 5) 
This figure, taken directly from census reports, indicates the 
median school grade reached by adults twenty-five years old 
and over. 

Per cent of Illiteracy in the Adult Population. (Variable 6) 
The number 25 years and over having four years schooling oF 
less is divided by the total number 25 and over. 

Per cent of Adults Who Are High-School Graduates. (Variable 
7) Computed as for Variable 6, using those reporting twelve 
or more years of schooling. 

Per cent of Males Employed. (Variable 8) Obtained by 
dividing the number of males fourteen and over gainfully 
employed in other than publie works (WPA, etc.) by the total 
number of males fourteen and over. 
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Per cent of Females Employed. (Variable 9) A similar figure 
for females fourteen and over, computed in the same way as 
Variable 8. 

Persons per 1000 Engaged in a Profession. (Variable 10) 
The number of men and women reported as working at a pro- 
fession was divided by the total population of the community. 

Male Domestic Servants per 1000 Population. (Variable 11) 
The number of males reporting their occupation as domestic 
Service was divided by the total population of the community. 

Female Domestic Servants per 1000 Population. (Variable 12) 
Computed in the same way as Variable 11. 

Male Laborers per 1000 Population. (Variable 13) Com- 
puted in the same way as Variable 11. 

Per cent of Homes Owner-Occupied. (Variable 14) The 
number of owner-occupied residential units was divided by the 
total number of residential units in the community. 

Per cent of Homes Tenant-Occupied. (Variable 15) Computed 
in the same manner as Variable 14. 

Per cent of Homes Overcrowded. (Variable 16) ‘The number 
of residence units occupied by more than 1.5 persons per room 
was divided by the total number of residence units reporting. 

Per cent of Homes Needing Major Repair. (Variable 17) 
The number of residential units needing major repair was 
divided by the total number which were reported on with respect 
to this item. 

Per cent of Homes Lacking Private Bath. (Variable 18) Com- 
puted in the same manner as Variable 17. 

Per cent of Owner-Occupied Homes Mortgaged. (Variable 19) 
The total number of owners reporting mortgages on their homes 
was divided by the total number responding to the question. 

Median Home Rental. (Variable 20) Taken directly from 
census figures. : 

Per Capita Retail Sales. (Variable 21) The total of retail 
Sales reported by the stores of the community was divided by 
the total population. р 

Per Capita Food Store Sales. (Variable 22) The total retail 
Sales reported by food stores was divided by the total population. 

Per Capita Retail Sales for County. (Variable 23) Computed 
in same way as Variable 21, but based upon the complete county 
1n which the community was located. 
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Average Pay in Retail Stores. (Variable 24) Total pay to 
employees in retail trade was divided by the number of such 
employees reported for the community. 

Data for the twenty-four predictor variables and the three 
community indices were punched on IBM cards and the complete 
matrix of intercorrelations was computed. These correlations 
were based on records for one hundred fifty-four towns and cities. 
Data were also available for twenty-eight county units, and these 
were used to ‘cross validate’ the values obtained for the urban 
units. The correlations among the twenty-four predictor vari- 
ables are shown in Table I. The correlations of the predictors 
with the intelligence index, the age index, the achievement index, 
and the achievement index with age held constant are shown in 
Table II. This table also gives the mean and standard devia- 
tion of each variable and the correlations among the three com- 
munity indices. 

Interest focuses first of all on the correlations of the variables 
with the intelligence index. Inspection of the appropriate 
column of Table II shows a considerable range of values, with а 
number that are statistically significant. With one hundred 
fifty-four cases a correlation must exceed .20 to be significant at 
the one per cent level, and eleven of the correlations of community 
variables with intelligence index surpass this value. Highest 
correlations are with measures of education of the adult popula- 
tion (.36, —.43 and .33), measures of home ownership and its 
reverse (.37 and —.39) and with indices of the quality and cost of 
housing (—.30, —.30, and .32). The signs of the correlations 
depend upon whether the desirable or undesirable end of the 
dimension being studied corresponds to a large numerical score- 
Other significant correlations are with proportion of native-born 
whites (.28), rate of female employment (—.26) and frequency 0 
professional workers (.28). Some of these variables appear tO 
have fairly obvious direct significance, others to have indirect 
significance as symptoms of some more basic underlying variable. 

The prediction obtainable from combinations of variables #28 
studied by determining the multiple correlation for the most 
promising combinations of two, three, four, five and six variables, 
following essentially the Wherry-Doolittle procedure. Results 
are shown in Table III. The multiple correlation increase 
fairly rapidly, with the addition of variables, until it reache 
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TABLE II.—ConnzELATIONS oF PREDICTOR VARIABLES WITH COM- 
MUNITY TEST AND Асе INDICES 
(Including Means and Standard Deviations) 


Correlation 
Varisble Mean| SD > Corrected 
x Achieve- Aghieva- 
IQ Index рн ment 
Index 
1. Population in 1000's 28.9 | 47.3|—.13|—.14 | —.06 —.04 
2. Per cent native-born white 80.5 | 10.6] .28|.—.15 | —.03 00 
3. Per cent under 5 years old 7.2| 1.1|-.04| .29 07 01 
4. Per cent over 21 years old 66.7 3.4| .19|-.35 | —.02 05 
5. Median adult school grade reached 9.3] 1.1) .36|-.18 17 21 
6. Per cent of adults illiterate 8.7 $.8|—.43| .37 01 —.07 
7. Per cent adults graduated from high 
school 31.2 | 10.0] .33—.15| .17 .20 
8. Per cent employed males 14 years and 
over 64.8 | 6.8] .19|-.13 | —.02 .01 
9. Per cent employed females 14 years 
aud over 24.7 | 5.8.—.20| .07 | —.03 | —.04 
10. Professional workers per 1000 popu- 
lation 30.5 | 13.8| .28—.18| .21 25 
11. Male domestic servants рег 1000 popu- 
lation 1.1] 1.9.13] .13| .07 o 
12. Female domestic servants per 1000 
population 17.6 | 13.0 —.17| .20| .06 02 
13. Male laborers per 1000 population | 23.4 | 12.3,—.00| .09| —.10 | —.12 
14. Per cent homes owner-occupied 45.1 | 10.3] .37|—.18 | —.03 00 
15. Per cent homes tenant-occupied 51.2 | 10.3|— .39| 18 .01 —.03 
16. Per cent homes overcrowded 5.6 4.8|—.30| .41 .05 -.08 
17. Per cent homes needing major repair |-14,4 | 9.7|—.18| .21| —.13 | —.18 
18. Per cent homes lacking private bath | 29.8 | 16.4 —.13| .46| —.07 | —-18 
19. Per cent owner-occupied homes mort- 6 
gaged 44.2 | 14.5 .00 Е 
20. Median home rental value (dollars) | 25.8| 9.5 -09 a 
21. Per capita retail sales 509.4 |190.3 02 103 
22. Per capita food store sales 122.0 | 33.2 11 qp 
23, Per capita county retail sales 326.8 | 97.8| .02 eu 
24. Average annual pay in retail stores 814.2 |161.8 .04 67 
25. IQ index 100.1 | 4.0 46 
26. Age index 49.2| 7.3 10 
27. Achievement 49.8] 4.5 .19 


about.55. Beyond that point the increase was very slow, and 
the ceiling appears to lie between .55 and .60 for the set ° 
variables used in this study. i 
Though the correlation found between IQ and оошу 
variables is appreciable, it is quite a bit lower than "aub 
reported by E. L. Thorndike, Maller, and Davenport and 
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TABLE IIL.—M ur.TIPLE CORRELATIONS AND REGRESSION 
Weicuts — Community Factors vs. IQ 


EEE 


Number of variables analysed 


Variable 
2 3 4 5 6 

1. Per cent of adults il- 

literate —.37 |—.21 |-.16 |—.15 |—.18 
2. Median home rental +.23 |4+.27 |4-.22 |+.22 |+.18 
3. Per cent homes tenant 

occupied —.27 |—.30 |—.20 |—.18 
4. Professional workers per 

1000 +.13 |--.18 |+.20 
5. Per cent employed fe- 

males —.17 |—.21 
6. Per cent employed males +.10 

Multiple R 


mers. There are a number of factors which may have had a 
part in bringing this about. Mention may be made of the 
following: 

1) Substantial population mobility, due to World War II, 
between the date of the census (1940) and the date of testing 
(1945). 

2) Non-correspondence between census enumeration units 
and educational units. 

3) Attendance of some children, varying in number and type 
rom one community to another, at private and parochial schools. 

4) Failure to include Negro children in the testing program in 
many of the communities having segregated school systems. 

5) Use of small communities with possible lowered reliability 
of all measures. 

These seem all to be factors which would tend to obscure the 
true relationship between community variables and the intel- 
ligence measure. The present results should probably be con- 
Sidered an underestimate of that relationship. ! age 

To provide some basis for judging whether the predictors 
which were most effective in the sample of one hundred fifty- 
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four towns and cities would maintain their effectiveness in 
another sample of communities they were tested out on twenty- 
eight county units for which test data were also available. From 
one point of view the county units are rather unsatisfactory for 
the ‘cross-validation’ test, since their characteristics are quite 
different from those of the urban communities. However, 
insofar as the same factors are found to be predictive for the 
counties, the significance of those factors is shown to be more 
general than would be the case by a test merely in a new group of 
urban communities. 

'The most valid single variable, and the most valid combina- 
tions of two, three, and four variables were applied to the twenty- 
eight counties, using the weights shown in Table III. Predicted 
IQ's were caleulated for each county, and these were correlated 
with the calculated mean IQ. Table IV shows the resulting 
correlations as well as the mean and standard deviation of each 
variable. 


TABLE IV.—MzaAN, STANDARD DEVIATION, AND CORRELATION 
WITH MEASURED IQ ror Preprcrep IQ ВАзЕр on CoMMUNITY 
VARIABLES 
(Data from 28 County Units) 


Mean SD Correlation 


Single Most Valid Variable 97.6 3.23 -61 
Composite from Two Variables 97.1 2.93 .67 
Composite from Three Variables 98.3 3.40 .57 
Composite from Four Variables 98.1 3.11 58 
Measured IQ 94.1 6.61 


The results from this analysis are somewhat difficult to inter- 
pret, because the county units are substantially more variable aD 
measured IQ than was the case for the urban communities. 
While the validity of each composite is higher than was the case 
for the urban communities, the standard error of estimate bas? 
on the counties is higher than the standard deviation for 
urban communities. Thus, the relative effectiveness Oi.  . 
predictors in the two cases is difficult to estimate. Two ven 
do seem clear. One is that the relative weight to be giver. is 
the four variables would be quite different for the county bg » 
Тыз seen from the fact that the validities resulting fro™ 
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three and four variable composites are lower than those resulting 
from only one or two variables. The other is that the rural- 
urban factor itself, or something intimately associated with it, 
is a significant factor in determining intelligence test score, over 
and above the other predictor factors. This is indicated by the 
difference between mean predicted IQ and mean measured IQ. 
The measured IQ/s averaged three to four points below the 
predictions. Apparently the ruralness of the county units 
constituted a handicap of this size. 


TABLE V.—MULTIPLE CORRELATIONS AND REGRESSION WEIGHTS 
Community Facrors vs. ACHIEVEMENT 


Number of Variables 


Analysed 
Variable — 
2 8 4 
Professional workers per 1000 +.24 | 4.27 | 4.26 
Per cent homes needing repair —.16 —.15 —.18 
Per cent employed females —.11 —.16 
Male domestie servants per 1000 4.12 
Multiple R .293 .912 .328 
c cud NEN NEUE o -— 


Attention may now be turned to the achievement index. 
Turning again to Table II, it can be seen that the correlations 
with achievement index are of quite a different magnitude from 
those with IQ. The highest correlation obtained, after correction 
for the age factor, was one of .25 with the number of professional 
Workers per 1000 of population. Correlation with median school 
grade reached by the adult population is .21. These are the 
only correlations above .20 and significant at the one per cent 
level. One other measure, per cent of adults who are high-school 
graduates, yields a correlation of just .20. There is, then, very 
little evidence that these community variables have any rela- 
tionship with the achievement index for the community, as 
measured by the Metropolitan Achievement Test. Multiple 
correlations with achievement index are shown in Table V. 
It appears that the ceiling of multiple correlation lies not far 
above .30. 
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At first thought, the relatively very low relationships between 
community factors and the measure of educational achievement 
seem quite surprising. One argues that if the educational, 
sociological and economic factors in a community make a differ- 
ence, this difference should appear more in the frankly learned 
school achievements than in the general measure represented by 
an intelligence test. However, several hypotheses may be 
offered to account for the low relationships. 

In the first place, the Metropolitan Achievement Test focuses 
upon the more conventional and standard objectives of education. 
It may be that some of the skills which it covers receive sub- 
stantially less emphasis in the more favored communities, and 
that for this reason those communities do no better on these 
skills than the poorer communities. In order to test this, 
separate analyses were made of two of the Metropolitan sub- 
test scores. One subtest, paragraph reading, was chosen 28 
representing one that it was felt would be heavily emphasized 
in all schools. Another, arithmetical computation, was chosen 
because it was considered representative of the type of skill 
which would be less emphasized in the favored communities. 
Correlations were computed between these subtest scores an 
eleven selected predictor variables which had correlated appre" 
ably with IQ. These correlations are shown in Table VL 
together with those for IQ. 

The results in Table VI are in general accord with our hypothe- 
sis. The correlations for paragraph reading correspond roughly 
to those for IQ. All but one have the same sign, and they show 
some correspondence in relative size. If the test weights which 
gave a multiple correlation of .55 for IQ are applied in the cas? 
of paragraph reading, the composite correlates .29 with the read- 
ing score. In the case of arithmetical computation, however, 
the pattern of correlations shows no correspondence with that 
for IQ. In six of eleven cases correlations are actually reverse 
in sign; that is, factors associated with high community 1Q are 
associated with low community arithmetic scores. The weights 
which gave a multiple correlation of .55 with IQ yield a corre” 
tion of .02 with arithmetic. These results may be explained 1 
terms of a de-emphasis on such skills as arithmetical computa 
tion and spelling in the schools of the more advanced sa 
communities. It appears that shifts in educational empbas! 
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have produced a situation in which the more conventional tests 
of achievement no longer provide an adequate basis for com- 
parative appraisal of communities as a whole, though they may 
still be useful for studying the individual in relation to his own 
community. Other types of appraisal are apparently needed if 
the accomplishments of the schools in outstanding communities 
are to be assessed adequately. 


TABLE VI.—ConnELATIONS оғ PREDICTORS WITH IQ, PARAGRAPH 
READING AND АвітнмеТІС COMPUTATION SCORES 


Paragraph Arithmetic 


Predictor IQ Reading Computation 

Per cent native-born white .28 .08 —.16 
Per cent over 21 .19 .05 .08 
Median school grade reached .36 .83 .07 
Per cent of adults illiterate —.48  —.18 .09 
Per cent employed males - 19 „ЛИ —.04 
Per cent employed females —.26  —.06 .05 
Professional workers per 1000 .28 .27 .16 
Male domestie servants per 

1000 —.13 .02 .06 
Per cent homes tenant-occupied —.39 —.18 .18 
Per cent homes needing repair —.18 — —.17 —.13 
Per cent homes lacking bath — —.30 — —.18 —.17 


_ А second possibility is that the community variables analysed 
in this investigation are not the ones which are the most impor- 
tant determiners of educational achievement. It may be that if 
variables dealing with school expenditures, school salaries, library 
facilities and the like had been included, substantially better 
prediction of the achievement index would have resulted. 
Unavailability of this type of information for the many small 
communities made it impossible to test this hypothesis. * 
Thirdly, the hypothesis may be advanced that fundamentally 
education is pretty highly standardized in these United States, 
and that it is primarily in the non-school factors that communi- 
ties differ. Ву this hypothesis, the schools would be thought of 
as a standardizing influence, and educational achievement would 
be expected to be less responsive to community variables than 
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would non-school indices. This hypothesis does not lend itself 
readily to experimental test. 
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HOW ELEMENTARY-SCHOOL TEACHERS MEET 
SELECTED SCHOOL SITUATIONS 


FRANK SLOBETZ 


State Teachers College 
St. Cloud, Minnesota 


This paper is a résumé of a study made by the writer at the 
University of Missouri during the school year, 1948-1949. The 
central problem was to determine what elementary-school 
teachers did when faced with certain school situations. Included, 
also, in the study was an attempt to make comparisons of what 
the elementary-school teachers did on the basis of such teacher 
characteristics as age, sex, grade levels taught, training, expe- 
rience, marital status, and parental status. Furthermore, an 
analysis was made of the teachers’ attitudes toward the selected 
school situations used in the investigation. The chief purpose 
of the study, therefore, was to determine how competent ele- 
mentary-school teachers meet selected school situations. More 
specifically, an attempt was made to answer the following 
questions: 

1) How do the more competent elementary-school teachers of 
Missouri meet selected school situations? 

2) How is the way in which the situations were met related 
to age, sex, grade level taught, semester hours of training, 
teaching experience, marital status, and family status? 

3) What type of situations do teachers rate the most serious? 

4) How are the ratings of the most serious situations related to 
the several teacher-characteristics classifications? 

5) What type of situations do teachers rate the most annoying? 

6) How are the ratings of the most annoying situations related 
to the several teacher-characteristics classifications? 


METHOD OF INVESTIGATION 


Data were secured by means of an information blank designed 
to elicit written statements by elementary-school teachers 
Judged by their administrators as the ‘more competent’ teachers. 
Seventy per cent of the two hundred eight Missouri public schools 
of high school district status invited to participate accepted, 
and nearly seventy per cent of the four hundred twenty-nine 
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blanks sent out were completed and returned. The participating 
schools from which returns were received were well distributed 
over the State of Missouri, representing eighty-six of the one 
hundred fourteen counties in the State. 

The elementary-school teachers selected by their administra- 
tors as the more competent may be described briefly as follows: 
Nearly three-fourths of them were thirty-six years old or older. 
Practically all of them were female teachers. Grouped by 
grade levels taught, the participating teachers were almost 
equally distributed in the two levels, grades I-II-III and 
IV-V-VI, with about one-sixth comprising the grades VII-VIII 
level. Nearly two-thirds of them fell into the 120-149 semester 
hours of training group, the remaining one-third being rather 
uniformly divided among the three other training groups: 60-89, 
90-119, 150 and more semester hours. Over three-fourths had 
more than ten years of teaching experience. Over ninety-five 
per cent had six or more years of teaching experience. Over 
one-half of the teachers were married and, of these, 52.1 per cent 
were parents. 

Teachers were requested to write in the space allotted below 
each of the forty-five situations what they had done about it if 
they had met it or one similar to it. They were instructed, 
also, to write ‘Have not met’ if they had not encountered 2 
situation or one similar to it in their teaching experience. А 

The forty-five situations were created to include the basic 
behavior problems reported in Wickman’s! study. In addition, 
the list included five exemplary behavioral situations. 

The situations, classified by types, are presented below: " 

Type I. Related to Classroom Decorum.—Fred would not sit 
still. He was in and out of his seat several times in about 25 
many minutes. Richard played a practical joke on one of the 
girls, causing general laughter, Mary and Jane were giggling 2? 
interfering with the work of the group. You had to leave your 
room for a few minutes; when you came back you found the 
children quite noisy and milling about the room. Mary whi* 
pered at every opportunity. John and Bill were shooting paP® 


1 E. К. Wickman, Children's Behavior and Teachers’ Attitudes, New York: 
The Commonwealth Fund, Division of Publications, 1928. 
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wads (or throwing things) while you were busy with another 
group. Ann was inclined to monopolize class time by talking 
about her vacation trip. 

Type II. Related to Authorities or School Regulations.— 
Johnny was excused to go to the rest room and was gone for 
twenty minutes. Mary was chewing gum. Jimmy had the 
habit of throwing his coat on the rack or on the floor. Four of 
your boys were playing marbles for ‘keeps.’ Mary was rude 
to you while you were talking to her about her carelessness. 
Sam ignored your suggestion that he clean up his desk. 

Type III. Related to Application to School Work.—Albert was 
physically lazy. He showed little interest in his school work. 
Bill came to school with dirty face and hands. Jack was fifteen 
minutes tardy one morning. Eddie was careless and untidy in 
his work. After you explained clearly what the group was to do, 
Bill later asked you for the same information. George was а 
non-conformist—he wanted to do things his way. 

Type IV. Related to Aggressive and Antagonistic Behavior.— 

Ann was very critical of others. June dominated her play group, 
and bossed her classmates with a dictatorial hand. Frank 
flew into a temper tantrum when he couldn’t have his way. 
Max was a bully; he liked to torment smaller children. Mary 
liked to tattle on others. John and Jim had a quarrel over 
sharing some materials. Howard and Sam had a fight on the 
playground. John deliberately broke his paint brush, issued to 
him by the school. 
А Туре V. Related to Morality and Integrity.—Jim told highly 
imaginative tales about his activities. James played with his 
genital organs during the reading period. You discovered that 
Mary was cheating on the examination. Johnny took an apple 
from one of the lunch pails. Betty took a nickel that did not 
belong to her. Richard used profane language while on the 
playground. Jack wrote a vulgar note to one of the girls. 

Type VI. Related to Withdrawing and Recessive Behavior.— 
Bob was a shy newcomer. He found it difficult to adjust. Ben 
Was a physical coward; he was afraid to stand up for himself. 
Mark was a quiet boy and never bothered anyone. Eleanor 
was suspicious of her classmates. She told you that they were 
talking about her. Richard's feelings were hurt because-he^was 
not chosen to serve as librarian. - 
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Type VII. Related to Exemplary Behavior.—Sam held the 
door open for his classmates as they came in the building. A 
group of your boys volunteered to lend their basketball to the 
girls. John found a dollar bill in the school building and brought 
it to you. Mary told you that it was her fault that the scissors 
were lost and that she was sorry. Jane shared her new story 
book with her classmates. 

Since teachers were asked to report actual treatment of the 
situations in an open-question type of inquiry, it was necessary 
to analyze the statements to discover the basic techniques 
involved. The pattern of treatments presented in this study 
evolved outrightly from this method of treating the data pro- 
vided by the teachers. 


FINDINGS 


In the original dissertation, the writer organized the findings 
by devoting one chapter to each of the seven types of situations. 
Each chapter presented one comprehensive table showing 
specifically how all teachers met each of the indicated situations. 
Included, also, in each chapter were seven other tables which 
showed comparative percentages by teacher-characteristi¢s 
classification of how the elementary-school teachers met the 
situations related to the indicated types. One chapter W8? 
devoted to the attitudes of teachers toward the forty-five 
situations. 

For purposes of this paper, some of the data have been re-0rgan" 
ized to present in briefer form certain of the more importan 
findings. Table I shows how two hundred ninety elementary" 
School teachers met the forty behavior-problem situations. 
One hundred thirteen specific measures, classified under thirteen 
types, were reported employed by the teachers. On a роліне 
constructive dichotomy basis, Table I reveals that slightly 2% 
than one-fourth of all measures used were punitive in nature, 27 
slightly less than three-fourths were constructive in nature 
Physical Force, Censure, Overtime or Extra Work, Deprivation 
Sent or Referred to Office, and Penalties were considered gu 
in nature. Ignored or Did Nothing, Verbal Appeal, v 
Reaction, Constructive Assistance, and Commendation pn 
considered constructive in nature. Rectification or Керага 
was considered neither. 
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Taste L—How тне 290 ELEwENTARY-sCHOOL TEACHERS MET 
THE Forty BEHAVIOR-PROBLEM SITUATIONS 
(Figures in parentheses give frequency) 
How Situations Were Met Per cent 
Physical Force (134): 1 

Spanked (106), Shook (15), Tied in seat (6), Slapped 
(5), Obstructed pupil’s desk (1), Held pupil (1) 

Censure (1088): 10 

Scolded (173), Commanded (114), Warned (68), Refused 
to listen (62), Used saturation (56), Refused to help (54), 
Secured apology (52), Reciprocated (45), Shamed (36), 
Questioned (36), Looked at (34), Identified publicly (29), 
Indicated disappointment (26), Required sharing with 
group (23), Destroyed item (21), Refused to accept work 
(20), Embarrassed (17), Used sarcasm (17), Required pupil 
to stand near his seat (15), Lectured (14), Required repeat 
writing (14), Stood near pupil (13), Refused to recognize 
(13), Indicated privately discovery (10), Shook head in 
disapproval (10), Seated pupil near teacher (9), Required 
heads on desks (8), Threatened (8), Demanded respect (8), 
Required standing in corner (8), Stopped and waited (8), 
Soaped mouth (7), Ridiculed (6), Sent home (6), Hushed 
(5), Secured confession (4), Displayed poor work (4), 
Scoffed at (4), Indicated displeasure (4), Kept list of 
names (4), Made comparison (4), Laughed at (4), Required 
repeating to teacher (3), Impersonated pupil (3), Indicated 
surprise (2), Sent for parent (2), Required keeping coat on 
(1), Required use of broken item (1), Required covering of 
eyes with hands (1), Required putting glue and cotton on 
fingers (1), Required pupil to stick gum on end of nose (1). 
Overtime or Extra Work (486): £ 

Required to repeat work (189), Required making up time 
lost (121), Kept in (91), Assigned extra work (70), Required 
to clean up (15). 

Deprivation (1044): 

Deprived recreational time (223), Isolated (171), Re- 
arranged seating (150), Denied privilege (112), Denied 
use of materials (95), Omitted from group activity (94), 
Assigned less attractive work (74), Restricted participation 
(68), Removed from class (41), Took away article or 
item (16). 
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TABLE I.—Continued 


How Situations Were Met Per cent 


Sent or Referred to Office (65): 
Penalties (99): 

Demerits (95), Money fines (3), Non-promotion (1). 
Rectification or Reparation (214): 

Required replacement (150), Required payment (56), 
Required giving up of personal article (6), Required 
double replacement (1), Paid for by teacher (1). 

Ignored or Did Nothing (512): 
Verbal Appeal (2586): 

Used reasoning (1771), Reminded (318), Made simple 
inquiry (218), Requested cessation (162), In behalf of the 
group (109), In behalf of teacher's regard (8). 

Group Reaction (143): 
Constructive Assistance (3167): 

Tried to create opportunity for successful participation 
(638), Tried to provide appropriate activity (338), Helped 
through pupil assistance (279), Suggested Correction 
(207), Conferred with or contacted parent (206), Created 
Situation to provide insight (185), Varied procedure or 
participation (152), Talked to group about situation or 
condition in general (151), Tried to provide incentives 
(148), Accepted situation with group (132), Served as 
arbiter (96), Assigned special responsibility (95), Respected 
his ideas and held him responsible for group codperation 
(82), Repeated directions (81), Helped directly to meet 
it (63), Tried to arouse emulation (57), Arranged for play 
with his peers (50), Suggested hand activity (43), ‘Kidded’ 
pupil, (33), Repeated later (24), Listened to pupil (17), 
Saw that bully met his match (16), Instituted immediate 
class work (10), Suggested pupils work it out amicably (8), 
Organized a club (8), Held frank discussion (7), Assigned 
committee work (7), Secured reconciliation (6), Suggested 
another time and place (6), Created attention-getting 
situation (8), Deferred action (3), Suggested substitute 
(3), Provided protection for pupil (3). 

Commendation (57): 4 

Personal (39), Public (11), Used as teaching situation 
(4), Via report card (3). 
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TABLE I.—Continued 


How Situations Were Met Per cent 
Searched for Reasons of Behavior (620) 6 
Tried Many Things Unsuccessfully (29) 0.3 
Total Number of reports on situations met (10244) 99.4 
Reports of non-encounter ( 1356) 
Total number of reports (11600) 


Table II presents a comparison of how the teachers—classi- 
fied by age, sex, grade levels taught, semester hours of training, 
years of teaching experience, marital status, and parental 
status—met the forty behavior-problem situations. The per- 
centages shown were computed on the basis of the number of 
situations encountered. 

Percentage differences within each classification and for each 
type of situation and for all situations considered together were 
treated statistically for significance. Critical ratios were deter- 
Mined by dividing the differences by the respective standard 
errors of the differences. No critical ratios indicating significance 
at levels ranging from five per cent to one per cent were found 
for any of the differences between percentages shown in Table II. 
Hg ratios approaching significance were found as indicated 

elow: 


Type I 
(25 or Less)—(26-35) CR: 1.4 
(46 or More)-(26-35) CR: 1.6 
(120-149)-(90-119) CR: 1.4 
Type V 
(1-2-3)-(7-8) CR: 1.4 


On the basis of Tables I and II, the following summary state- 
ments may be made: 

1) In meeting situations related to Classroom Decorum, 
teachers used constructive measures slightly more frequently 
than they employed punitive ones. 

2) In meeting situations related to Authorities or School 
Regulations, teachers employed constructive methods about 
twice as frequently as they used punitive measures. 
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Taste IL —AÀ Comparison or How 290 ELEMENTARY-SCHOOL 
TEACHERS Мет Forty BEHAVIOR-PROBLEM SITUATIONS IN 
TERMS OF PERCENTAGES OF CONSTRUCTIVE MEASURES 


Uszp 
u-——É— АЕ — ———— e 


Per cent of Constructive Measures 


VI 


No.of| Used According to the Six Types 
Clasdifeation CA of Situations 
‘ ers in == 
of Teachers Fach 
Class} I | I | HI | IV | V 
Ages 
25 or Less 11 | 64 | 61 | 80 | 67 | 71 
26-35 70 | 48 | 67 | 79 | 61 | 62 
36-45 120 | 53 | 65 | 80 | 59 | 67 
46 Plus 89 | 56 | 66 | 77 | 62 | 68 
Sex 
Female 277 | 53 | 65 | 79 | 60 | 68 
Male 13 | 60 | 68 | 72 | 72 | 64 
Grade levels taught 
1-2-8 117 | 54 | 69 | 83 | 60 | 71 
4-5-6 127 | 52 | 64 | 77 | 62 | 66 
7-8 46 | 52 | 60 | 74 | 61 | 59 
Semester hours of 
training 
60-89 34 | 49 | 64 | 80 | 58 | 63 
90-119 38 | 47 | 60 | 74 | 64 | 66 
120-149 181 | 59 | 66 | 79 | 60 | 67 
150 Plus 37 | 54 | 69 | 80 | 66 | 72 
Years of teaching 
experience 
2-5 12 | 67 | 63 | 78 | 56 | 65 
6-10 52 | 52 | 64 | 76 | 61 | 71 
10 Plus 226 | 53 | 66 | 80 | 61 | 66 
Marital status 
Single 123 | 54 | 67 | 80 | 62 | 60 
Married 167 | 53 | 65 | 77 | 60 | 65 
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Тлвів II.—Continued 


В Per cent of Constructive Measures 
No. of] Used According to the Six Types 
Classification Teach- of Situations 


of Teachers SI 


Each All 
Class} I | IT | IIL] IV | V | VI Types 

Married 
With Children 87 | 50 | 61 | 77 | 59 | 62 | 97 | 68 


Without Children} 80 | 55 | 67 | 79 | 59 | 68 | 97 | 71 


All Teachers 54 | 66 | 79 | 61 | 67 | 97 | 71 
Мыз ee END Lid NAE! RED ee 
Type I Seven situations related to Classroom Decorum. 
II Six situations related to Authorities or School 
Regulations. 
III Six situations related to Application to School-work. 
IV Eight situations related to Aggressive and Antago- 
nistic Behavior. 
V Seven situations related to Morality and Integrity. 
VI Six situations related to Withdrawing and Recessive 
Behavior. 


3) In meeting situations related to Application to School 
Work, teachers used constructive measures about four times as 
often as they used punitive measures. 

,4) In meeting situations related to Aggressive and Antago- 
nistic Behavior, teachers used constructive measures about twice 
as often as punitive ones. 

5) The constructive methods employed by all teachers in 
meeting situations related to Morality and Integrity constituted 
Dearly seventy per cent of all measures used. 

6) Nearly ninety-seven per cent of the measures used by 
teachers in meeting situations related to Withdrawing and 
Recessive Behavior were constructive in nature. 

7) In terms of teacher-characteristics classifications, по 
nificant differences were found in how teachers met the situations, 
Considered by types or by all situations as à whole. 


no sig- 
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8) The two hundred ninety teachers made 11,600 reports on 
how they met the forty behavior-problem situations. Of this 
number, eleven per cent were of non-encounter. Types of 
measures employed by all teachers in connection with the forty 
situations, in order of frequency of use, were: Constructive 
Assistance (thirty-one per cent), Verbal Appeal (twenty-six 
per cent), Censure (ten per cent), Deprivation (ten per cent), 
Searched for Reasons of Behavior (six per cent), Ignored or Did 
Nothing (five per cent), Overtime or Extra Work (four per cent), 
Rectification or Reparation (two per cent), Group Reaction 
(two per cent), Physical Force (one per cent), Penalties (one per 
cent), Commendation (0.5 per cent), and Sent or Referred to 
Office (0.6 per cent). Slightly more than one-fourth of the 
measures employed in meeting the forty situations were punitive 
in nature and slightly less than three-fourths were constructive 
in nature. 

In order to assemble pertinent data about the treatment 
of the situations related to Exemplary Behavior, Table ПІ was 
constructed. How the teachers handled these situations 
reported in terms of six categories and in terms of frequency by 
per cents. As Table III indicates, teachers used the Com- 
mendation technique ninety-four per cent of the time. In terms 
of teacher-charaeteristics classifications, no significant differences 
were found in the use of the Commendation technique. a 
significant difference (CR: 2.64) at one per cent level was foun 
for Ignoring or Doing Nothing between teachers with ten youre 
or more teaching experience and those with two to five years р 
ехрегіепсе. 


ATTITUDES 


In addition to the written reports on how they had met the 
forty-five situations, the participating teachers were as e ird 
indicate the most serious, the second most serious, and the thi 
most serious situations. They were also asked to indicate a 
most annoying, the second most annoying, and the third m 


P š А И to 
annoying situations. In effect, the teachers were asked. m 
ee 


eighty teachers indicated their attitudes in the 
scribed. In order to consolidate the three attitudinal exp" 
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TABLE III.—A Comparison or How 290 ELEMENTARY-SCHOOL 
TEACHERS Мет Five SITUATIONS RELATED TO EXEMPLARY 


BEHAVIOR 
No: df How Teachers Met Situa- 
Classificati usd tions and Per Cents of 
assification Teachers Rrequene 
of Teachers in Each eq | 
Саз |A'B|C|D E|F 
Ages 
25 or Less 11 0 12/2 |0 |0 | 8 
26-35 70 |0.3}4 |1 | 0.6/1 | 93 
36-45 120 1 1 1 0.2] 0.5| 96 
46 Plus 89 |1 |3 |1 | 0.2} 0.2 94 
Sex 
Female o" | 1 [29 |1 | 0.8) O76) 95 
Male 13 3 0 0 97 
Grade Levels Taught 
1-2-3 117 |0.73 |0 [0 | 0.4) 96 
4-5-6 127 |1 |4 |2 | 0.7) 0.5) 92 
7-8 46 0.5) 3 2 0 Т 98 
Semester Hours of Train- 
ing 
60-89 34 10 |4 |3 | 0.6) 0.6) 92 
90-119 38 |0 |4 [о | 0.6/0 | 95 
120-149 181 1 3 1 0.2) 0.7, 94 
150 Plus 37 0.7 2 1 0 0.7| 95 
Years of Teaching Ex- 
perience 
2-5 12/0 о |2 јо |0 | 98 
6-10 52 |o |6 |1 [0.40.4 92 
10 Plus 226 1 3 1 0.3] 0.7| 94 
Marital Status 
Single 123 |0.9 2 |2 | 0.5) 0.7 94 
Married 167 |0.9 4 |1 | 0.1) 0.5) 94 
arried 
With Children вт |0.8 3 |1 | 0.3) 0.3) 94 
Without Children so |1 |4 | 0.8/0 |0.8| 93 
All Teachers 0.9| 2.7| 1. | 0.3] 0.6 94 


Key: A—Rectification or Reparation. B—Ignored or Did Nothing. 
C—Verbal Appeal. D—Group Reaction. E—Constructive Assistance. 


—Commendation. 


ma 
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into a single index, the three ranks were weighted by multiplying 
the frequencies for ranks 1, 2, and 3 by 3, 2, and 1, respectively. 

These attitudinal indices were converted into percentages as 
Table IV indicates. This table reveals that slightly over one- 
half of the ratings as to seriousness were directed at situations 
related to Morality and Integrity. About one-third of the rat- 
ings were divided almost equally between situations related to 
Aggressive and Antagonistic Behavior and situations related to 
Withdrawing and Recessive Behavior. 

Table IV also reveals that over one-third of the ratings as to 
annoyance involved situations related to Classroom Decorum. 
Situations related to Application to School Work and those 
related to Aggressive and Antagonistic Behavior were rated 
almost as annoying as the Classroom Decorum type. 


TABLE IV.—PERCENTAGE DISTRIBUTION or 280 ELEMENTARY- 
SCHOOL TEACHERS’ RATINGS or THE Tures Mosr SERIOUS 
AND THE Turer Mosr ANNOYING SITUATIONS CLASSIFIED 
BY TYPES or SITUATIONS 


Most Most R 
Types of Situations Serious Annoying С 
Situations Related to Morality and 
Integrity 50.4 3.0 148 
Situations Related to Aggressive and 21 
Antagonistie Behavior 17.1 24.9 2. 
Situations Related to Withdrawing 0 
and Recessive Behavior 16.1 5.6 ^4 
Situations Related to Application to 0 
School Work 13.1 $5 Ж 
Situations Related to Authorities or 1.4 
School Regulations 2.1 4.8 É 
Situations Related to Classroom De- 17.0 
corum 1.2 35.7 : 
Total Per Cents 100.0 100.0 
The critical ratios shown in the table were computed м 
dividing the percentage differences between corresponding os, 
of situations by the respective standard errors of the a one 


All are significant at the one per cent level, except two; 
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of these approaches significance at the two per cent level. These 
statistics indicate that the teachers considered situations related 
to Morality and Integrity and to Withdrawing and Recessive 
Behavior more serious than annoying; and situations related to 
Classroom Decorum, to Application to School Work, and to 
Aggressive and Antagonistic Behavior as more annoying than 
serious. 

For comparative purposes, Table V was constructed. Teach- 
ers’ ratings of the three most serious situations were converted 
to percentages and compiled by classifications of teachers and by 
types of situations. Statistical treatment for significance of 
Percentage differences within each classification and for each 
type of situations produced the following significant critical 
Tatios: 


Type V CR Level 
(60-89)—(150 or more) 1.95 5% 
(90-119)—(150 or more) 2.5 296 
(120-149)—(150 or more) 2.1 5% 

Type VI 
(26-35)—(25 or less) | 2.84 5% 
(36-45)—(25 or less) 2.68 1% 
(46 or more—(25 or less) 2.40 2% 
(150 or more)—(60-89) 2.55 2% 
(150 or more)—(90-119) 2.10 5% 
(150 or more) —(120-149) 2.38 5% 


With respect to situations related to Morality and Integrity 
(Type V), teachers with semester hours of 60-89, 90-119, and 
120-149 considered situations of this type more serious than 
teachers with 150 or more semester hours. 

Critical ratios for situations related to Withdrawing and 
Recessive Behavior (Type VI) indicate that the older groups 
of teachers considered this type of situation more serious than 
the youngest age group, 25 or less. Significant differences were 
also found for Type VI in the semester hours of training classi- 
fication. Teachers with 150 or more hours rated these situations 
More serious than teachers in the three other groups. 

As Table VI shows, teachers’ ratings of the three most annoying 
Situations were converted into percentages and compiled by 
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TABLE V.—PrzncENTAGE DISTRIBUTION oF 280 ELEMENTARY- 
SCHOOL TEACHERS’ RATINGS OF THE THREE Most SERIOUS 


SITUATIONS CLASSIFIED By ТүрЕЅ or SITUATIONS 


DEN NSG 


Num- | Percentages for Each Type 


Classification ber of Situation 
of Teachers Тенор rma а 
ers | I] II II|IV| V | VI 
Ages: 
25 or Less 10 о | 3.3] 6.790 |68.3) 1.7 
26-35 66 |1.3] 4.317.415.445 |16 
36-45 118 | .4| 1.7]13.1]16.851 [17 
46 Plus 86 2.2 1.411.317.0,50 [16 
Sex 
Female 267 |1.2} 1.8/13.2/17.6/50 [16.4 
Male 13 12.319.2/19.2/31.517.8 
Grade Levels Taught 
1-2-3 nui 1.7 1.813 [17.749.516.4 
4-5-6 125 | .7| 2.4|12.5/16.0,50.5]17-4 
7-8 44 1.9 3.116.816.950 [11-9 
Semester Hours of Training 
60-89 33 |1 | 2.614.217.8|51.8| 9-б 
90-119 39 0 | 7.8| 9.110 [59.713-“ 
120-149 173 | .9| 1.8/15.7117.7(50.2|13-8 
150 Plus 35 3.8 2.4| 6.721.481.989-8 
Years of Teaching Exp. 
2-5 12 |o | s.217.817.845-2] d 
6-10 52 |1.6| 4.211.916 [52.2147 
10 Plus 216 1 |1.813.917.249.716- 
Marital Status 7.5 
Single 121 | .7| 2.4/15.7]19. bns 
Married 159 |1.6| 2.2]11.7]15.2/54-2]?- 
Married 15.1 
With Children 83 |2.5] 1.410.414.5/56 15.2 
Without Children 76 | .9| 3.113.2|15.6|52 Р 


9: 
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TABLE VI.—PzncENTAGE DISTRIBUTION OF 280 ELEMENTARY- 
SCHOOL TEACHERS’ RATINGS ОЕ THE THREE Most ANNOYING 
SITUATIONS CLASSIFIED BY TYPES OF SITUATIONS 


Classification 


Num- Percentages for Each Type 


ber o 


of Teachers Teach- Бец 
ers T. | IL [шт TY | У 

Ages: 

25 or Less 10 |38.310 |25 (21.75 |0 

26-35 66 |37.4] 6.4/28.2:20.8| 1.65.6 

36-45 118 |32.4| 3.329.225 3.4/6.1 

46 Plus 86 |87 | 3.4/23.1127.9) 3.4/5.2 
Sex: 

Female 267 |36.1| 4.126.6/25.1 2.55.6 

Male 13 |81 т |21.123.9|14.12.8 
Grade Level Taught 

1-2-3 111 |34 | 4.5)24.5]27.2) 3.3/6.5 

4-5-6 125 136.4] 4.1/27.3/23.5| 3.5/5.2 

7-8 44 141.1] 4.425.8/28.8| .84.1 
Semester Hours of Training 

60-89 33 |46.6| 4.7123.6/16.2| 1.6/7.3 

90-119 39 40 5.7|23.2]80.7| 3.5) .9 

120-149 173 [86.1] 4.5/28.5/22.3| 2.26.7 

150 Plus 35 |31.4] 1.520 (36.8) 7.82.9 
Years of Teaching Expe- 

rience 

2-5 12 М2 7.3/23.2:24.06| 2.90 

6-10 52 |42.1| 5 |22.8/25.5) 1 (8.6 

10 Plus 216 |34.1) 3.7|25.2|27 3.5/6.3 
Marital Status 

Single 121 [34.7] 5.2/25.3/27.6) 1.8/5.4 

Married 159 |36.4| 3.6/27.5/23.1 3.8/5.6 
Married 

With Children 83 141.5] 3.5/24.0/20.9| 8.95.6 
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classifications of teachers and by types of situations. Statistical 
treatment for significant percentage differences indicates the 
following critical ratios: 


Type IV CR Level 
(150 or more)—(60-89) 1.94 5% 
Type VI 
(36-45)—(25 or less) 2.76 1% 
(46 or more)—(25 or less) 2.17 5% 
(10 years or more)—(2-5 years) 3.80 1% 


Teachers with 150 or more semester hours considered situations 
related to Aggressive and Antagonistic Behavior more annoying 
(approaching significance) than teachers with 60-89 semester 
hours. 

The most significant critical ratios were found in connection 
with situations related to Withdrawing and Recessive Behavior. 
Teachers in age classification, 36-45, considered these situations 
more annoying than teachers of 25 or less, as did the oldest 
group of 46 or more. The most experienced teachers, 10 year? 
or more, considered this type more annoying than teachers with 
two to five years of experience. 


RANK ORDER DATA 


Teachers’ ratings of the most serious situations in rank order 
are as follows: (1) stealing nickel, (2) sex irregularity, (3) cheating 
on examination, (4) vulgar note, (5) daydreaming, (6) temPe? 
tantrum, (7) laziness, (8) bully, (9) non-conformity, (10) stealing 
apple, (11.5) suspiciousness, (11.5) profanity, (13) quiet behavior 
(14) shyness, (15) domination, (16) cowardice, (17) ecd 
behavior, (18) inattention, (19) rudeness, (20.5) carelessno 
(20.5) marble playing, (22.5) noisiness, (22.5) property destru 
tion, (24) fighting, (25) imaginative tales, (26) tattling, © 
monopolizing class time, (29.5) overactivity, (29.5) chew? 
gum, (29.5) ignoring teacher, (32) quarreling. ts ай 

Teachers’ rating of the most annoying situations ap ing: 
order are as follows: (1) inattention, (2) tattling, (3) whisper s 
(4) overactivity, (5) giggling, (6) daydreaming, (7 по 
(8) laziness, (9) bully, (10) temper tantrum, (11) non-conform 


- ^. 
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(12) paper wads, (13) carelessness, (14) domination, (15.5) chew- ' 


ing gum, (15.5) critical behavior, (17) rudeness, (18) monopolizing 
class time, (19) cheating on examination, (20) suspiciousness, 
(21) tardiness, (22) fighting, (23) property destruction, (24) pro- 
fanity, (25) vulgar note, (26.5) quarreling, (26.5) throwing coat 


on floor, (29) ignoring teacher, (29) sex irregularity, (29) prac- - 


tical joke, (31) undue absence from class, (32) cowardice, (34.5) 
uncleanliness, (34.5) imaginative tales, (34.5) hurt feelings, 
(34.5) stealing nickel. 

'The rank-difference correlation between the two rank-order 
ratings is .02. 


CONCLUSIONS 


On the basis of the findings and within the framework of 
limitations indieated in the study, the more important con- 
clusions seem to be those presented below. 

1) In meeting behavior-problem situations, the designated 
competent elementary-school teachers operated from a con- 
Structive point of view, with some evidence of searching for the 
reasons of behavior when certain situations were faced. 

2) Situations of the Exemplary type were generall met 
by the designated competent teachers with specific forms of 
commendation. 

3) Teachers employed the highest percentages of construc- 
tive measures in connection with Withdrawing and Recessive 
Behavior type of situations, and the lowest with situations 
related to Classroom Decorum. 

4) In terms of the séven teacher-characteristics classifications, 
no significant differences were found in the way teachers treated 
the situations, either by types of situations or by all forty 
behavior-problem situations considered as a whole. 

5) The teachers were most seriously concerned with situations 
related to Morality and Integrity. About one-sixth of their 
ratings included situations related to Aggressive and Antago- 
nistic Behavior and about the same portion of the ratings were 
directed at situations related to Withdrawing and Recessive 
Behavior. 

6) The three chief types of annoying situations were those 
classified as Classroom Decorum, Application to School Work, 
and Aggressive and Antagonistic Behavior. 
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7) Situations related to Morality and Integrity and to With- 
drawing and Recessive Behavior were considered more serious 
than annoying; and those related to Classroom Decorum, to 
Application to School Work, and to Aggressive and Antagonistic 
Behavior as more annoying than serious. 

8) Teachers with the greatest amount of training considered 
situations related to Morality and Integrity less serious than 
teachers with lesser amounts of training. 

9) The oldest group of teachers considered Withdrawing and 
Recessive Behavior situations more serious than the youngest 
group. Teachers with the most training considered these situa- 
tions more serious than teachers with less training. 

10) Teachers with most training considered situations related 
to Aggressive and Antagonistic Behavior as more annoying than 
teachers with the least training. Р 

11) The two older groups of teachers considered situations 
related to Withdrawing and Recessive Behavior more annoy1Dg 
than the youngest group of teachers. The most experienced 
teachers considered these situations more annoying than the 
least experienced teachers. 

12) The findings suggest that elementary-school teachers 
show more real differences in their attitudes toward behavior 
of children than in their treatment of such behavior. 
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THE RELATIONSHIP EXISTING BETWEEN 
BILINGUALISM AND RACIAL ATTITUDE* 


GRANVILLE B. JOHNSON, JR. 
Emory University 


In many regions of the southwest United States there are 
groups of people who find it necessary to use two languages for 
normal social intercourse: Spanish in the home and English in 
schools and in business transactions. As in most bilingual situa- 
tions, one language is given more social acclamation than the 
other, since it is representative of the more dominant culture. 

The study of language may be much more than language study, 
per se, since it is justifiable to assume that language is a reflection 
of the personality structure of the individual! If personality 
does, as Frank assumes, “organize experience in terms of its own 
private idiosyncratic world of meanings,”? one may conclude 
with him that it is logical to extend this assumption to include 
an individual’s choice of language for self-expression as one aspect 
of personality. 

The purpose of the present investigation was to determine the 
relationship existing between the bilingual background of Span- 
ish subjects and the attitude of the Spanish toward the Anglo 
ethnic group. 


SUBJECTS AND MATERIALS 


Materials.— 

1) The Projective Test of Racial Attitudes composed of six 
carefully selected pictures relevant to race situations and pro- 
Vocative of projected response was utilized for the analysis of 
racial attitudes. 7 

2) A tabulation sheet was utilized for recording the dynamics 
of responses, 

3) The Hoffman Bilingual Schedule 


* This is the final article of a series of three concerned with the origin 
and development of racial attitude. The first, “An Experimental Pro- 
jective Technique for the Analysis of Racial Attitude,” appeared in April, 
1950, issue (41: 4). The second, “Тһе Origin and Development of the 
Spanish Attitude Toward the Anglo and the Anglo Attitude Toward the 
Spanish,” was published in May, 1950 (41: 5). 
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Subjects.— 

1) Anglo: thirty male subjects (four-, eight- and twelve-year 
levels, N = 90) from public schools in a southwestern town. 

2) Spanish: thirty bilingual male subjects (four-, eight- and 
twelve-year levels, N = 90) from public schools in a southwestern 
town. 

A further limitation was that members of both groups were 
required to have lived in this specific town for the year prior to 
testing. 

METHODS OF MEASURING BILINGUALISM 

Means of measurement of bilingualism may be classified into 
three categories: (1) Background questionnaires, (2) Association 
techniques, and (3) Rating scales. 

1) Background Questionnaires.—Prescott, in 1932, described 
a bilingual questionnaire of twenty items which covered questions 
concerning oral and written language influence in the child’s 
family background. He assigned a numerical value to each 
significant, item; the sum of these values represented the indi- 
vidual's foreign language index. Other questionnaires of similar 
character (e.g., Hoffman, 1933) have developed since this time. 

The technique employed in the present investigation utilize 
the Hoffman Bilingual Schedule. 

2) Association techniques.—M. Gali of Spain has proposed two 
methods for the measurement of degree of bilingualism. The 
first of these methods is a test of immediate verbal memory. 
Two parallel series of ten words—ten in Spanish and ten 10 
Catalan—are orally presented to the child, each series being 
read three times with a fixed time interval in between the words- 
At the end of the presentation the children are requested to mer) i 
duce on a piece of paper the words which they are able to recall б 

Gali utilized the chain association method in which he ра 
sented eight words in Spanish given alternately with eight ne 
Catalan. The subject responded with any word in either of th 
two languages which occurred to him within a fixed time? — . d 

Saer employed an association method to measure the affect 
value of words in the two languages of the bilingual тоду fe 
Fifty words representing situations, persons, objects and a = 
that normally are part of a child’s world at the age of Ба m 
selected. "These fifty words in English and their irene A] 
Welsh . . . without any definite order of presentation ® 
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the English or Welsh words are given to the child individually. 
The responses given in either language are noted. Account 
is taken of the association time for each word in each of the two 
languages. The association time for the Welsh word is divided 
by the time of the association for its equivalent in English. This 
quotient is equal to 100 when the association times for the two 
responses are equal. A score of less or more than 100 will indi- 
cate the greater or smaller affective value of the situation, object, 
person, or action in one or the other of the two languages. A 
quotient of approximately 100 will show that the child is truly 
bilingual in reference to the particular situation, object or person 
denoted by the word.* 

3) Rating Scales.—Degree of language assimilation represents 
а continuum extending from zero to one hundred per cent. 
Malherbe divided this continuum into six progressively com- 
prehensive stages, thus making it possible to compare roughly 
the two languages of a bilingual individual. In the study the 
Hoffman Bilingual Schedule was employed to measure the 
bilingual background of the Spanish subjects. 

The test in its final form presented the following questions to 
Which five responses were possible: Never, Sometimes, Often, 
Mostly, Always: 

1) Do the following speak to you any language other than 
English? (a) Father. (b) Mother. (c) Grandfather. (d) 
Grandmother. (e) Brothers and Sisters. (f) Relatives. 

2) Do you speak to the following any language other than 


English? (a) Father. (b) Mother. (c) Grandfather. (d) 


Grandmother. (e) Brothers and Sisters. (f) Relatives. 

3) Does your father speak to the following any language other 
than English? (a) Mother. (b) Brothers and Sisters. 

4) Does your Mother speak to the following any language 
other than English? (a) Father. (b) Brothers and Sisters. 

5) Do your Brothers and Sisters speak to the following any 
language other than English? (a) Father. (b) Mother. 

6) Do the following read any newspaper in a language other 
than English? (a) Father. (b) Mother. (c) You. 

7) Do the following read any books in a language other than 
English? (a) Father. (b) Mother. (c) You. 

8) Do the following write any letters in a language other than 
English? (a) Father. (b) Mother. (c) You. 
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9) Are letters written in a language other than English received 
in your home? 

10) Do the following attend lectures given in a language other 
than English? (a) Father. (b) Mother. (c) You. 

11) Do the following attend the theatre where plays are given 
in a language other than English? (a) Father. (b) Mother. 
(c) You. 

12) Are radio programs which are given in a language other 
than English listened to in your home? 

13) Do you do your thinking in a language other than English? 

14) Are there any books in a language other than English 
in your home? [This question is answered: (a) None. (b) 
Some. (c) Мапу. (d) Most. ог (е) AIL] 

The major conclusions Hoffman drew from analysis of the 
test are in summary: 

Validity, found by correlating the bilingual scores against 
ratings as to the extent of bilingual background is .73 = .08 

Coefficient of correlation between bilingual scores and estimates 
of bilingual background based on interviews is .82 — .03 

Validity was established by demonstrating that the test 
differentiates between groups whose extent of bilingual back- 
ground is relatively unknown. 

Retest reliability coefficient (interval of three weeks) 18 81 
= .02 

Reliability (split-halves) is .845. When corrected by Spear- 
man-Brown, the coefficient is .92 for the total schedule. 

There appeared to be no relationship between bilingual back- 
ground and chronological age or with grade status for ages te? 
to fourteen and grades V to VIII. | ; 

No sex difference in regard to either size or variabili 
bilingual scores was reported. EC 

This test was administered to each Spanish subject at the 8 
of the presentation of the Projective Test of Racial Attitu a 
It was found, early in the investigation, that the Spanish айаш 
trator was more satisfactory than the Anglo. This was in р? 
because of his knowledge of the Spanish language and culture- 
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PROCEDURE dé 
The purpose of the present investigation was to determine 


relationship existing between the bilingual background o 
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selected Spanish subjects and the attitude of the sample Spanish 
at the chosen age levels toward the Anglo ethnic group. 

The method of procedure used to ascertain this relationship 
was to derive the prejudice score from each of the Spanish proto- 
cols of the Projective Test of Racial Attitudes and correlate it 
with the bilingual score of the Hoffman Bilingual Scale. 


RESULTS 


Table I presents the mean and standard deviation of the 
selected Spanish subjects on the Hoffman Bilingual Scale. 


TABLE I.—Tur MEAN AND STANDARD DEVIATION OF THE SPAN- 
ISH SUBJECTS ON THE HorrMAN BILINGUAL SCALE 


M Cn c 
12 181.001 9.078 48.885 
Age Levels 8 157.900 10.382 55.905 


4 104.512 9.501 51.165 


Though the technique for establishing bilingual background 
was identieal throughout the age groups, the Spanish at the 
twelve-year level were revealed to possess a greater (though not 
significantly so) bilingual background than subjects at the eight- 
year level, and the eight-year was greater than the four. It is 
possible to explain this feature on the basis that, though the 
frame of reference set up for the study excluded all subjects who 
had not lived in the community for a year, this at the four-year 
level represented a minimum of one-fourth the total experience 
of the subject. This weighting decreased progresssively with 
age. It was more possible, therefore, at the older levels, for the 
Subject to have spent eleven-twelfths of his life in rural districts 
with their concomitant emphasis on the Spanish language. 

The relationship existing between the bilingual score and the 
total prejudice score yielded the results found in Table II. It is 
observable from this table that the rectilinear relationship 
existing between bilingual background and prejudice increases 
progressively with age. The eta correlations were made to 
ascertain if any curvilinear functions were present. It may be 
noted that the Nay did not deviate significantly from rectilinear- 
ity, but the Nyz demonstrated that, at the four-year level, 
decreasing progressively through the eight and twelfth years, 
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there is a tendency for those subjects with least prejudice to have 
the highest and lowest bilingual scores. 

Though this curvilinear function at the four-year level is 
possibly reflective of parental disposition, it indicates, neverthe-" 
less, that a profound knowledge of the Anglo culture or no 
knowledge of it at all yields least bias toward it. Possibly, with 
less bilingual background, the Spanish become part of the 
Anglo eulture and in many cases identify themselves with it. 
This tendency might explain the finding previously discussed for 
many of the younger Spanish subjects to be prejudiced in favor of 
the Anglo. 

: To analyze this problem in greater detail, the degree of correla- 
tion between the bilingual score and each of the following cate- 
Eories was computed: Effect of Environment, (Frustrating); 
Reaction to Environment, (Frustration); Adequacy of Principle 
Character, (Subordinate); Ending Hero, (Defeat); Ending Hero, 
(Victory); and Ending Theme, (Unsatisfactory). 

These correlations bore out the findings of the total analysis: 
the rectilinear relationship between bilingual background and 
Prejudice tends to increase with age; but at the four-year level, 
decreasing progressively through the eighth and twelfth years, 
those subjects with the highest and lowest bilingual scores have 
the least prejudice. 

At the four-year level, the rectilinear relationship between 
Prejudice and bilingual background was negative, the Nzy is 
Insignificant, and the Nyz is at the .30 level of significance. This 
last finding would indicate that those individuals at the four-year 
level with the most and least bilingual background had the least 
tendency to end the theme unsatisfactorily. At the eight-year 
level, however, those subjects with the highest and lowest 
bilingual backgrounds had equal prejudice. At the twelve- 
year level the curvilinear (Nyx) relationship (significant at the 
01 level) was the reverse of the findings at the four-year level 
which would indicate that, at the oldest age level, those indi- 
Viduals with the greatest and least bilingual backgrounds tend 
to end the theme unsatisfactorily between the Spanish and 
Anglos. This finding could possibly indicate that the twelve- 
year Spanish with low bilingual backgrounds realize the barrier 
between the Spanish and Anglos and consider resolving it with 
Pessimism. Those Spanish with intensive bilingual backgrounds, 
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however, may end the theme unsatisfactorily at this level as a 
result of increased social intercourse with the Anglos who are 
quite prejudiced at this age. This contact touches the Spanish 
ego, and ending the theme unsatisfactorily may be a negativistic 
device utilized to resolve tension. 

The rectilinear correlation which shows greatest increment 
from younger to older levels is that concerned with the adequacy 
of the principle character. This would indicate that, with age, 
the relationship between bilingual background and feelings of 
superiority increases. It is possible that feelings of ‘national’ 
pride along with ego involvement and identity may explain this 
finding. 

The rectilinear correlations which deviate from the general 
trend are found only in Adequacy of Principle Character, (Sub- 
ordinate) and in Ending Hero, (Defeat). ‘This would indicate 
that as age increases there is less tendency for subordination an 
defeat of the hero to be associated with a high bilingual back- 
ground score. This factor, too, may be explained on the basis of 
pride resulting from frustration. 


SUMMARY AND CONCLUSIONS 


The purpose of the present investigation was to determine the 
relationship existing between the bilingual background of the 
Spanish subjects and the attitude of the sample Spanish at the 
chosen age levels toward the Anglo ethnic group. А 

The method of procedure used to ascertain this relationship 
was to derive the prejudice score from each of the Spanish proto- 
cols on the Projective Test of Racial Attitudes, and compute үе 
degree of relationship between it and the bilingual backgroun 
score of the Hoffman Bilingual Schedule. 
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bilingual background, the Spanish become part of the Anglo 
culture and in many cases identify themselves with it. This 
tendency might explain the finding for many of the younger 
Spanish subjects to be prejudiced in favor of the Anglo. 
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INTRAUNIVERSITY VARIATIONS IN GRADING 
PRACTICES 


BERNARD M. BASS 
Louisiana State University 


There has been an increasing interest among psychologists 
concerning criterion relevance and reliability. College grades 
are a criterion for many test validation studies as well as the 
basis for evaluating ‘How to Study’ courses and educational 
counseling programs. Grades also serve as predictors of success 
in graduate schools, professional schools and industry. Yet, 
relatively little information is available concerning the extent 
to which non-achievement factors contaminate the assignment 
of college grades. -— 

The present study involved a three-component analysis o: 
variance of mean grades! assigned by thirty-three departments 
at three course levels? for four continuous semesters at a ber 
state university. This analysis held constant the number 0 
grades contributing to a given mean by treating the means only а 
Contributing to the formation of the three hundred ninety-9!* 
means were 139,659 grades assigned in the four semesters from 
the Fall of 1947 to the Spring of 1949. d 

Table 1 shows the analysis of variance of the three hundre 
ninety-six mean grades and the appropriate F ratios obtained. 

The null hypothesis that no interaction existed could 
rejected at the one per cent level of confidence. It was inferre 
that at different course levels, different departments деше, 
significantly in mean grade assigned from the course level in 
for all departments. For example, two departments actua t 
graded more severely, in the absolute sense, in their per^ 
senior courses than in their freshman-sophomore courses W: ps 
two departments assigned lower grades in graduate wo» 
than in junior-senior courses.: Only seven of the thirty-t 


rded 
1 Mean grades were obtained by assigning four points to each A aw® 


А ach 

by a department at a given level, three points to each B, two points to € 
C, one point to each D and no points to each F awarded. ching 2t 

? Only departments giving courses at all academic levels and beer 
least five hundred students each semester were selected for this ап 

3 Freshman-sophomore, junior-senior and graduate levels. 

4 бее below concerning the average increase in mean grades & 
levels. 


t successive 
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departments consistently graded lower than the level averages 
at all three levels and only six departments graded higher than 
the level average at all three levels. Thus only thirteen depart- 
ments of the thirty-three studied seemed to maintain the same 
relative intradepartmental evaluation standards at all levels of 
Instruction. 


TABLE 1.—ANALYsIS OF VARIANCE OF THE GRADING SYSTEM 


Source of Variance ss d.f. Y. 
Among departments (d) 17.1741 32 5.367 
Among course levels (1) 73.7550 2 36.878 
Within cells (we) 9.3982 297 .032 
Interaction (dzi) 16.0367 64 .251 
Total 116.3640 395 

F = Ve = 7.930 Р < .01 

P = Va = 

F = у = 2.141 Р < .01 

Fa = 147156 Р<.01 
Каз 


‚ The variance associated with changes in course levels was 
Significantly greater than the interaction at the one per cent level 
of confidence. The mean for all graduate courses was 3.48 or 
B+, the mean for junior-senior courses was 2.87 and the mean 
for the freshman-sophomore level was 2.43. It was inferred 
that the mean grade change from level to level was significant 
above and beyond changes due to departmental variations and 
Semester fluctuations. 

The null hypothesis that the variance of means among depart- 
ments could be accounted for by the interaction variance was 
rejected at the one per cent level of confidence. It was inferred 

hat above and beyond semester fluctuations and variance 
associated with increasing course levels, departments had differ- 

Ing mean grades. For example, three departments’ freshman- 
Sophomore averages were higher than a fourth department’s 
graduate average. The range of mean grades of departments 
ав a whole was from 2.46 to 3.42. 
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Assuming that the grading practices at the one university 
studied are common to many others, the results of this study 
suggest to the writer that perhaps those working on further 
refinements of scholastic aptitude tests may increase the effi- 
ciency of the tests in the future by developing series of regression 
equations specific to individual departments and course levels. 

In the evaluation of ‘How to Study’ courses there is a need for 
more detailed matching of experimental and control groups. 
The greater mean increase in grades of the experimental group 
may accrue from the interaction between departments and 
levels. More of the experimental than the control group may 
take courses in departments whose grading practices become 
much more lenient at succeeding levels. Department an 
level should be included in any matching that is done. y 

This study also suggests the need to consider the possibilities 
of revising present college grading practices. 
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NOTES ON THE COEFFICIENT OF AGREEMENT 
J. WILLIAM DUNLAP 


School of Public Health, Harvard University 


| On numerous occasions situations arise where a number: of 
individuals are required to rate or rank a group of items, objects, 
or individuals. Distributions of the ratings assigned the several 
items, objects, or individuals reveal varying degrees of spread, 
representing heterogeneity or disagreement among the raters. 
The degree of failure to agree can be estimated by inspecting the 
distributions. The disagreement can be quantified by measuring 
the deviation about the mean rating. Two standard statistics 
are available for this purpose, the mean deviation and the stand- 
ard deviation. The first of these weighs the deviations linearly, 
and the second, by a function of the sums of the squared devia- 
tions. The latter function has the advantage of being a more 
elegant statistic, but is more difficult to compute. In this 
respect, the mean deviation is simpler, and it has the further 
advantage that when dealing with ratings which are of unknown 
reliability, of not giving undue weight to extreme deviations. 

‚ A situation which often arises is one where the research worker 
in dealing with the laity needs to express the degree of agreement 
as а percentage function to facilitate comparisons. There is 
по readily available function for so doing, but such a measure 
сап Ье derived from either the mean deviation or standard devia- 
tion. The former has been selected here, because of simplicity 
of calculation and the nature of the material to which it is to be 
applied. 

The mean deviation is the sum of the deviations about the 
Mean, without regard to sign, divided by the number of observa- 
tions. The magnitude of the mean deviation is strictly depend- 
ent on the sum of the deviations. In the case where N indi- 
viduals rank a given item or person, the sum of the deviations 
Can be readily obtained by adding the N/2 largest rankings and 
subtracting from this sum the total of the N/2 lowest rankings. 
The maximum disagreement between two raters occurs when one 
Tater places item or person first and the second places it last. 
Therefore, the maximum disagreement within a group of raters 
occurs when half rate an item first and half rate the same item 
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last. That is disagreement is a maximum when it equals 
N/2(H-L). (1) 


Where: (H-L) is the greatest possible range between rankings, 
i.e., the highest possible rank minus the lowest possible rank. 


A measure of disagreement is provided by the following expres- 
sion: 
УТ — ZB (2) 
N72(H-L) 


Where: T is the top fifty per cent of the rankings and B is the 
bottom fifty per cent of the rankings. 


Since this expression is a measure of disagreement, it follows that 
when disagreement is greatest the result equals one, and when the 
raters are in perfect agreement the result is zero. This can be 
adjusted so that we have an expression of agreement expresse 
as a percentage, as shown below: 

zT — ZB | (3) 
^ N/2(H-L) 


An example will clarify the application of the formula: 


Coef. of Agreement = 100 |: 


Rank Item A Item B 
- iC cate ЖУ H 

a NET / 
а Сазои / ^ 
Энн не ЕЕЕ КҮЙ ЫЛ К c DM e HTT 


For Item A the three lowest ranks, given by the six raters к> 
1, 1, and 2, the sum of which is four, and the three highest d 
are 2, 3, and 4 which total to nine. The greatest possible geh 
(H-L) is 5 minus 1 which equals four and N equals 6- 


fore, substituting in (3) we have the C.A. 
9—4 
. = = == | = 58 
С.А. = 100 [1 eui 58% Е 
For Item В the three lowest ranks are 3, 5 and 5, totalling 


be 
4 R inator сап 
* Note that the differences in both numerator and denomin& 
treated as pure numbers with regard to sign. 
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thirteen, and the three highest ranks are 5, 5 and 5 which total to 
fifteen. The greatest possible range is four. Substitution 
yields the following: 


_ _ 15 — 18] _ 
С.А. = 100 Е л = 83% 


In conclusion it should be emphasized that Coefficient of 
Agreement is a pragmatic but practical function, useful in work- 
ing with business and other personnel not versed in the intricacies 
of statistics. Unfortunately no sampling error is available for 
the function nor is the writer competent to provide one. 


BOOK REVIEWS 


Dovetas H. Fryer and Epwin R. Henry, Editors. Handbook 
of Applied Psychology. New York: Rhinehart & Co., 1950. 
Vol. 1, pp. 880. Vol. 2, pp. 462. 


These volumes contain five units dealing with the application of 
psychology (1) to group and individual efficiency and adjustment; 
(2) to business and industry; (3) to education; (4) to clinical 
problems; and (5) as a profession. For each of these, at the en 
of the second volume, a bibliography is provided listing major 
publications in the area as conceived by the contributors. At the 
beginning of Volume One, there is a three-page list of landmarks of 
professional psychology beginning with 1860 (introduction of 
psychophysical methods by Fechner) and ending in 1939 (publica- 
tion of the Dictionary of Occupational Titles). In all, there are 
one hundred fifteen sections grouped into eighteen chapters. . 

How should a handbook be judged? Validity of organization 18 
one criterion. On this ground, the five major sections of the 
handbook seem equitable. Another criterion is the allotment 9 
space to individual topics within each major heading—here W° 
find the articles of roughly equal length, three to five pages, with 
some exceptions that seem justified in the light of how much more 
we know in these fields. What about the stature of the contribu- 
tors—are they well known, not without some eminence in the 
fields on which they write? Неге we find a verdict somewher? 
between superior and excellent. To have Remmers writing 00 
attitudes, Tinker and Paterson on typography and legibility s 
reading, Shartle on job analysis, Richardson on effectiveness 0 
selection devices, Traxler on school classification, John Anderso 
on child development, Seidenfeld on physical disease—to Р! 
only a few almost at random—is to show that the editors have the 
felicity of judgment and the persuasiveness in getting good me 
to work that are indispensable for the success of such an enterpris? 

What about mechanical setup? The table of contents is pes 

plete and clear, and so is the alphabetical list of contributor, 

The typography is pleasant, dignified, appropriate. The index 

contributors is of dubious value except, perhaps, 

tributors themselves. The subject index ought to err on t lity 

of overcompleteness; we are willing to forgive uneven genera, 418 

of categories if we can generally find whatever we want. uti 
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not hard to put this index to tests it cannot pass. For example, 
the entry under “Item Analysis” refers solely to the section by 
Wherry on item analysis and tells us nothing about the excellent 
page that Flanagan presents, under “Educational Test Con- 
struction,” on the selection of test items. Where would one look 
if one wanted to read about ‘‘ homogeneous grouping,” or “ability 
grouping,” or “grouping” under any name? There is nothing in 
the index under these titles, and the major section on these 
matters, “School Classification" by Traxler, would never be 
found through the index if one looked under “Classification.” 
Similarly, there are additional treatments of school classification 
by Gordon V. Hendrickson and by Carter V. Good, who discuss 
instruction in elementary and secondary schools, and in college 
and university, respectively. No one could ever discover this by 
looking into the index. 

What about the adequacy of references to the literature? 
After all, a handbook can give us merely an entering wedge for 
serious work. To get more deeply into a problem, we need to go 
to the sources the contributors cite. Here we find, perhaps, the 
major shortcoming of these volumes. For some reason, they 
give us a “selected and classified bibliography in applied psy- 
chology” which omits most of the references by the authors of 
the various sections. You read that “Interest studies also have 
considered the correlation between degree of interest in а college 
course and the mark received (Fryer, 1927; Меепеѕ, 1935; Kulp, 
1935) and the effect of teacher popularity upon interest in school 
subjects (Corey and Berry, 1038)." You may immediately want 
to have the title and full reference to the respective publications 
of Fryer, Meenes, Kulp, and Corey and Berry. If you turn to 
the section on educational psychology of the bibliography at the 
end of Volume 2, you will find not one of these. Perhaps, if 
you look at the reading references at the end of the section, you 
find bibliographies, in the more general works listed, that will 
lead you to the relevant publications of Fryer and the others. 
But probably not. One wonders then what the purpose of the 
fifty-nine pages of bibliography at the end of Volume 2 may be. 

€ can not find in them what the authors of the various sections 
refer to. Are they perhaps a selective reading list in which the 
authors of textbooks and the organizers of courses may find the 
most significant materials in a given field? But the bibliogra- 
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phy is too extensive for that. The irritated reader can only con- 
clude that in designing the bibliography the editors, trying to save 
space, select, and organize, ‘‘o’erleaped themselves and fell on 
t’other side." 

How successfully is duplication and overlapping avoided? Is 
there cross-referencing where necessary? Here again, our judg- 
ment cannot be favorable. For example, the editors allow both 
Hendrickson and Good to devote precious space to the problems of 
homogeneous grouping when these were already thoroughly 
accounted for by Traxler. On educational acceleration, why not 
Substitute a cross-reference from Good's article to Pressey's and 
so save another half-page? Similarly, nothing is said in the 
Section on exceptional children that will take the reader into the 
two chapters on clinical psychology dealing with mental defi- 
clency, community child guidance clinics, speech difficulties, and 
the like. 

What is the picture of applied psychology that one gets from 
this handbook? One impression is that of tremendous diversity- 
Applied psychologists have not feared to tread. Psychological 
warfare, ventilation, metropolitan police personnel, building 
illumination, railroads, radio and television research, visual 
efficiency, physical disease, the courts, prisons and penitentiary, 
the rehabilitation of the aged, librarianship, eugenics, the theater 
—these titles of sections suggest the range of human concerns 20 
economic activities that applied psychologists feel qualified to 
deal with. Among the few areas untouched not only by t 
editors and their authors, but also by applied psychology itself, 
are agricultural work and politics. But from these volumes 
one gathers courage to predict that, before many years, the 
applied psychologists will have sent out scouts, deployed their 
forces, and colonized these areas, 

As is perhaps appropriate in writings on applied psychology, ^ 
get little of the systematic and theoretical flavor that permeau" 
the efforts of psychologists who do not call themselves 'appliec 

The assumptions, conceptualizations, constructs, theoretici 
frameworks, and chains of hypotheses that characterize PSY p 
ogy in general are here all right, but they are never made exp, 
and systematic. As we all know, the applied psychologist 18 0 РА 
to solve practical problems. That this can be done, aS gener 
tion researchers insist, without neglecting the task of build! 
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systematic theory, would never be guessed from this handbook. 
Rather, we have a kind of ‘interdisciplinary’ approach in that 
many of the articles are concerned not so much with psychology 
as with the same practical, horsesense kind of intelligent attack on 
problems that any bright layman might undertake, especially if 
given a smattering of the introductory course and a few statistical 
techniques. 

For readers of this Journa, we consider in detail only the two 
Chapters on educational psychology, which fill eighty-five of the 
large double-columned pages. 

_ Chapter IX, Educational Psychology: Techniques of Educa- 
tional Adjustment, begins with a section by Gertrude Hildreth 
describing the school psychologist’s services: coórdinating instruc- 
tion, studying individual children, and dealing with the slow 
learner, the behavior problem child, failures in school subjects, 
reading disabilities, physical handicaps, and gifted children. 
She also outlines the psychological testing, observational, and 
Interview techniques of school psychologists and their functions 
In promoting pupil-teacher relationships, curriculum adjustment, 
cumulative records, and home-school relations. 

i Arthur Traxler gives a circumspect analysis of the considera- 
tions involved in the classification of students into different grade 
evels and within single grades. Chronological age, age grade, 
Mental age, IQ, reading, and achievement age, as well as various 
formulas, are described and succinctly evaluated as bases for the 
grade classification of pupils. Ability grouping within single 
grades, inter-age grouping, and automatic promotion are similarly 
treated. His discussion ends with a cogent advocacy of modern 
Measurement and recording procedures integrated into & well 
Organized guidance program as the way out of the dilemmas con- 
fronted in any more mechanical scheme of pupil classification. 
Similarly, adequate individualization of educational experiences 

epends in the final analysis on the ability, initiative, and imagi- 
nation of the classroom teacher, above and beyond any classifica- 

tion scheme. ә A 

Percival Symonds’ section on principles of child guidance begins 
With a distinction between preventive and corrective guidance 
and points to the uniqueness of every case as militating аш 
the application of general rules. After а rapid summary ie 
ndings on the criteria of treatability, he discusses methods o 
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gaining the child's coóperation and the long-term nature of most 
readjustment processes. Since therapy is more and more con- 
sidered a ‘relationship,’ attention to both the child and his parents 
is ordinarily called for. But different clinicians should work with 
different members of the family. 'The therapy thus undertaken 
can be aimed at the elimination of Symptoms as in direct con- 
ditioning processes for curing enuresis; at removing frustrations 
asin changing a child's teacher or interesting him in a recreational 
group; or at the release of tension, change of attitude, and 
development of self-understanding as in psychotherapeutic 
interviews. As to Psychotherapy, Symonds quotes David 
Levy's Maternal Overprotection with its discouraging findings 
concerning psychotherapy as compared with education, environ- 
mental change, advice, and demonstration. A brief statement 
on criteria of improvement, mainly concerned with the dangers of 
too early cessation of treatment, closes the section. 

Morton Seidenfeld's section on the care and treatment of 
language deficiency describes the need for, organization, and 
functioning of the special training units set up by the Army 1n 
World War II to teach basic reading, writing, and arithmetic skills 
to the thousands of ‘illiterate’ young men inducted by selective 
service. After a straight-forward exposition of how the program 
operated, the author draws the lessons for civilian life that such 
skills are best taught to adults when built into the learner’s life 
milieu, that utilitarian values must be stressed, that relatively 
large gains in knowledge should be sought quickly at the start to 
enhance motivation, and that the social problems in removing 
illiteracy are at least as worthy of attention as the educationa 
ones. 

T. Ernest Newland and Lester N. Myer, dealing with exceP- 
tional children, distinguish between the education and care 9 
such children, offer a general definition of ‘exceptional children, 
and then briefly discuss the nature and incidence of тшепау 
retarded, mentally superior, visually handicapped, acoustically 
handicapped, speech handicapped, and physically delicate Pe 
orthopedic cases. Their estimates of the percentages of Americal 
children in each of these groups are three, three, twenty-fivy 
hundredths, three, six, and two, respectively. The education’. 
program for such children should deal with social and Вара 
adjustment as well as the three г?з. Only about fifteen рег © 
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of the cases are presently cared for in special classes and schools; 
the other eighty-five per cent (almost two and a quarter million) 
are either in regular classes or unlocated. Psychological services 
deal with the discovery and examination of exceptional children 
and with making recommendations for their educational adjust- 
ment, especially their social and personality training. Urgent 
needs exist for publicity among educators concerning this kind of 
education, for the early examination and study’ of all children, 
and for research on the effectiveness of special education pro- 
grams. Finally, the authors answer the questions, Why educate 
exceptional children? Why expend extra effort and expense in 
their interest ?—in terms of humanitarian values both to the chil- 
dren helped and to society. 
_ John С. Flanagan's article on educational test construction goes 
into the following topics: (1) basic principles of test construction, 
Ш which validity and ‘efficiency’ are defined; (2) outlines and 
Specifications for tests; (3) writing and editing test items, in which 
four levels (facts, generalizations, applications, and significances) 
are described and illustrated ; (4) the selection of test items, where 
he considers item validity (discrimination), difficulty, inter-cor- 
relation, time required, objectivity, face validity (acceptability), 
and answer defensibility; (5) the organization of a test, logically 
and typographically; (6) equating the forms of a test; (7) the 
Scaling of raw score units; (8) techniques for scoring test items; 
(9) the provision of norms, in which he outlines five primary types 
of interpretation: absolute performance in terms of content, 
relative performance in terms of rank in a specific group, per- 
formance with respect to that of the average individual in various 
Specified groups, performance with respect to the individual's 
9Wn previous performance, performance with respect to the 
individual's performance in other fields; and (10) other factors 1n 
the interpretation of results (motivation, guessing or scoring 
errors, and accuracy). E 
Sidney L. Pressey's section on accelerated higher education 
defines acceleration as “moving through an educational program 
in a shorter time or at earlier stages than is usual," and then 
ràises two questions: What are the most desirable ages for a given 
educational program? and What are the optimum rates of prog- 
Tess? His answers are based on historical precedent and on the 
findings of experimental studies. The general conclusion is that 
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acceleration has relatively satisfactory outcomes and that the 
major problem is how to overcome the "inertia of the enormous 
total institution of American education, which has made twelve 
years of pre-college and four years of college, and the usual school 
calendar, a basic pattern for student life and faculty habits of 
thinking...” 

Chapter X, Fields of Educational Psychology, begins with & 
section on child development by John Anderson. After abrief 
historical introduction, Anderson delineates the interdisciplinary 
character of child study and the interplay of science and practice 
that have characterized the field. Research on young children 
has considered the child as the independent variable, studied the 
effects of environment on behavior, and examined behavior în 
situ through various observational techniques. Education of 
young children in nursery schools, training of professional work- . 
ers, relationships of child development to general education, 
parent education, popular writing and radio, and clinical work 
with young children are the additional topics briefly characterized. 

Gordon Hendrickson's section on instruction in elementary and 
secondary schools takes up generalizations derived from research 
on individual differences, readiness to learn, motivation, genere 
patterns of teaching, audio-visual aids, and transfer of training 
After pointing out the facts of intra-individual and intra-class 
variability, he describes our experience with ability grouping an 
individualized instruction and draws the conclusion that teachers 
should expect different levels of achievement from their pupils 
unless the goals are severely circumscribed. Under readiness tO 
learn, we find the problem outlined with special attention #0 
reading and algebra; the conclusion is that readiness depends nO 
only on characteristics of the pupil but on the teacher's skills a? 
other factors. Under motivation are considered the inadequacy 
of instinct doctrine and the findings from studies of praise Y$: 
reproof, reward and punishment, knowledge of results, 220 
individual vs. group competition ; such studies too often negle^ 
the learner’s understanding of the learning situation. As 
general patterns of teaching, the ones considered are the recitatio? 
and laboratory methods, projects and activities units, and the 
unit-mastery plan, in each case with a summary of evaluate 

research on the method; the general implication is that {еза ОР 
success depends more on the adaptability of the teacher than 0 


= 
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any formal method. On audio-visual aids, we find condensed 
Summaries of the research on the effectiveness of motion picture, 
radio and recordings; the general limitation of these devices in 
enforcing pupil passivity is pointed out. Transfer of training is 
treated first with a review of pertinent research of the more 
traditional kind and then, with more encouraging results, in 
terms of the carry-over from activity-unit and other newer type 
Procedures; studies of the latter kind, properly;considered relevant 
to transfer of training, have yielded encouraging support for 
those who seek positive transfer from classroom activities to 
Intellectual, emotional, and social maturity. A final meaty 
Paragraph gives us principles useful in securing maximum transfer. 

Instruction in college and university is treated in a section by 
Carter V. Good. The topics he takes up are techniques of 
Investigation, class size, ability grouping and acceleration, 
Motivation, instructional methods, audio-visual aids, study 
Procedures, procedures for adjustment of the inferior and the 
Superior student, and examinations and marking. For each 
topic, surveys of the findings of representative investigations are 
Sven. From all this, Good sees needs for the evaluation in higher 
education of trends toward adjustment of the program to the 
individual student, toward comprehensive achievement examina- 
tions as substitutes for time spent in granting academic credit, 
toward organization of broader instructional divisions such as 
biological sciences or social sciences, and toward programs of 
Eeneral education. 

The section on predicting success in college and university by 
Edwin В. Henry begins with the rationale of admissions programs 
and of the problem of selective admission, discusses criteria of 
Success in college, and outlines predictive technique in terms of 
the well-known regression equation. The remainder of the 
Section takes up the typical findings with such predictors of 
academic success as secondary-school record, secondary-school 
Courses, college aptitude tests, personality measures, age at admis- 
Slon, size of family, part-time employment, and paternal 
Occupation. ^ 
h Horace B. English and George Nagy begin their section eh 

Professional School Admissions” by contrasting professiona 
with liberal education in terms of the former’s importance to the 


Individual and society, the personality traits and abilities required, 
LI 
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and the greater need for ethical, social service motivations. 
Criteria of professional success are continuance in the profession, 
membership in professional associations, advancement, research 
and publication, reputation, and income. Among the selective 
procedures commonly used are academic record; achievement, 
aptitude, interest and personality measures; health, financial, 
sex, race, religious, and residential characteristics. Following 
this general survey, the authors summarize the practices and 
results that have been obtained in graduate schools, medicine, 
dentistry, nursing, theology, law, engineering, and teaching. 
The conclusion is that the best single predictor of academic suc 
cess in professional training is previous academic grades; when 
combined with standard achievement tests, predictive accuracy 
reaches the limit possible with imperfectly reliable criteri. 

* The greatest need in the field is to develop criteria less narrowly 
academic and more concerned with ethics, social outlook, char- 
acter, drive, and personality. 

William D. Glenn, Jr. and Wallace Gobetz, writing on “ College 
Student Personnel Services," outline the student personnel point 
of view and the wide variety of jobs that are needed to perform 
student personnel functions on present-day campuses. , 
authors then give brief characterizations of the problems, finding 
and procedures of student personnel workers in dealing wit 
admissions, Selection of curriculum, orientation, health, ех 
curricular activities, counseling, remedial work, financial 855? 
ance, placement and follow-up. A final paragraph on nee p 
research points out the inadequacies of previous work and a bos 
of problems that have been relatively untouched. 5 

Outside of these two chapters on educational psychology, ss 
are many sections in other chapters of interest to the education” 
psychologist. Among the most pertinent are sections оп motiv® 
tion and self-direction (Douglas H. Fryer), interest in work ү 
play (Donald Е. Super and Jack W. Dunlap), aptitude and in dl 
ligence (George K. Bennett), guided learning (T. R- MeConn ei 
and G. Lester Anderson), vocational and educational satisfact 
(Robert Hoppock and Donald E. Super), administration ЕА 
psychological services in public schools (Bertha M. Luckey), § in- 
administration in public schools (Warren W. Coxe), and a "ties 

istration of psychological services in college and univers! 
(William D. Glenn, Jr., and Wallace Gobetz). 
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The section on guided learning by McConnell and Anderson 
defines learning, discusses its ubiquity and then outlines the 
process in terms of the eleven characteristics listed by Dashiell in 
1935. The function of motivation, the variety of changes in 
behavior that learning may bring about, and transfer of training 
are sketched. Guidance in learning stresses the need for more 
than mere repetition—the importance of consequences or effects, 
the proper distribution of practice, difficulty, and organization. 
In learning an active skill, we need first to define its nature, and 
then by direct observation, or manual guidance, properly organ- 
ized as to wholes or parts, in a situation maximally similar to that 
10 which the skill will be used, to achieve a flexible pattern adapt- 
&ble to the perceived demands of the situation. Under ideational 
learning, the authors stress the importance of meaningfulness and 
Organization as perceived by the learner and then take up whole 
and part learning, practice techniques, and the nature of meaning- 
fullness in learning. Forgetting is considered as the result of 
retroactive inhibition. Limitations to learning are characteristics 
of the learner such as his ability, various organic states, and phys- 
leal and social surroundings. In general, the principles of learn- 
ing are not invariant laws but rather expressions of significant 
Considerations in the control of learning. 

All in all, the editors and publishers of these volumes have done 
applied psychology a distinct service. These volumes may well 

ecome, if not the vade mecum because they are too bulky, at 

least a frequent source of quick acquaintanceships with dozens of 

areas. Graduate students, personnel men, thesis directors, and 

Workers in the vineyards of applied psychology will find help 

here. And not least, the historian of students of industrial 
Society will be fascinated by this handbook a century from now. 
N. L. GAGE 


University of Illinois 


Reciva Mary Gorr. Problems and Emotional Difficulties of 
Negro Children. New York: Bureau of Publications, 
Teachers College, Columbia University, 1949, pp. 93. 


This study investigates the kinds of difficulties Negro children 
ages ten to twelve report that they experience because of their 
Tace. Ninety children in New York City and sixty in St. Louis 
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interviewed by a Negro investigator from January to July, 1946, 
reported an average of three difficulties. These were categorized 
into overt manifestations (direct ridicule, physical ill-treatment, 
and aggressive behavior) and subtle manifestations (discrimina- 
tion, rude treatment, and indirect disparagement). Children 
were asked how they felt during these experiences, what impulses 
were aroused, what action they took, and what advice they 
received from parents. One hundred and fifty mothers (not 
necessarily mothers of children interviewed) were requested to 
relate difficulties on account of race repoited to them by their 
children, the guidance given, and its effectiveness. 

Comparisons were made of data by city, socio-economic level, 
and sex. A similarity in basic pattern of difficulties was found 
in New York and St. Louis although in New York subtle, indirect 
manifestations of prejudice and rude treatment were more coni 
mon; and in St. Louis, the overt forms of discrimination. The 
most frequently reported difficulty was ridicule; next in rank was 
disparagement created by movie and radio stereotypes. Dis- 
tribution of difficulties had negligible relationship to socio- 
economic level; however, low income children in exclusively 
Negro neighborhoods pay relatively greater attention to implied 
prejudice than do upper income children. Data suggest that 
girls are more sensitive than boys to manifestations of prejudice. 

Ridicule and physical aggression arouse resentment an 
impulse to fight; discrimination and rude treatment arouse 
inferiority feeling. Relatively more low income children than 
upper income children report inferiority feeling aroused by mov!e 
and radio stereotypes. Indirect disparagement provoked resent- 
ment accompanied by an inclination to do nothing about if 
Low income children exhibited no greater aggressiveness D 
response to race diffieulties than upper class children. The 
author explains this unexpected finding on the basis of selective 
sampling. Low income children were obtained through listings 
of community centers which are probably attended by less 
aggressive children. А 

Parental guidance appeared to be ineffective. Author stresse е 
need for parent education among Negroes. Instructions to nes 
draw were most frequently given by parents. They felt 
churches were ineffective in improving race relations, же 


a 
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skeptical of intergroup organizations, and favored more Negro 
teachers for Negro children. 

Three illustrative interviews are presented. After reviewing 
her data the author concludes that Negro children desire to 
Strike back in prejudice situations, but suppress their emotions 
and withdraw instead of taking active steps to face their prob- 
lems. In the course of her discussion of the implications of her 
study she states: “It is apparent that the Negro child needs an 
enriched program of training which places more emphasis on the 
building of attitudes toward himself—attitudes especially of 
Self-esteem, self-respect, and self-confidence.” 

The difficulties and pitfalls of the interview method as a 
technique of securing information must be considered in evaluat- 
P the findings of this study. Some of these are recognized and 
described by the author. 

This exploration into an area of paramount importance for 
American Society and particularly for education is commendable. 

t extends to a very narrow age range and generalizations made 
may give misleading impressions if this limitation is overlooked. 
Purp M. Kiray 


Adelphi College 


ALGERNON ConrMAN, Ciara B. Кіма, CLARE BALLUFF, AND 

Roserr Н. Firs. An Analytical Bibliography of Modern 

` Language Teaching, Vol. III, 1937-1942. New York: King’s 
Crown Press, Columbia University, 1949, pp. 549. 


This volume continues the series of reports begun in 1928. Tt 
brings up to 1942 the lists of books, articles, reports, and bulletins 
Concerned with progress in modern language teaching. Foreign 
language teaching abroad is omitted from the present volume. 

ach of the eight hundred fifty-three items included presents 
bibliographical material, a summary of contents and an evalua- 
tion of the contribution. А 
‚ Some of the trends evident during the period covered are: ап 
Increase of emphasis upon the relation of modern languages to 
Social sciences and their integration with cultural studies; & 
Vigorous interest in achievement tests; appreciation of experi- 
mental results; a rising interest in Spanish and Portuguese; 
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increased emphasis upon oral training and an increase of public 
interest in foreign languages. The more extensive sections deal 
with (1) aims, materials and method, (2) curricula-syllabi, and 
(3) examinations and tests. 

The summaries and evaluations are well done. This over-all 
view of trends in modern language teaching should be very useful 
to workers in the field. Mites A. TINKER 

University of Minnesota 
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A PROBLEM IN FACTORIAL DESIGN: 

THE DEVELOPMENT OF A PICTURE AND INSET 
TEST FOR DETERMINING YOUNG 
CHILDREN’S RESPONSES TO PERSONS 
OF DIFFERENT SKIN COLOR* 


CATHERINE LANDRETH and ELIZABETH FRAZIER PLATT 
University of California 


Recent investigations of young children’s social perception, in 
particular their perception of racial characteristics, 29:456, 
direct attention to the need for effective solution of the methodo- 
logical problems involved in such studies. The following report 
of an investigation, currently in progress, presents the writers’ 
Solutions to the problems they encountered in undertaking à 
Чу of young children’s responses to persons of different skin 

olor. 

Investigations to date of this aspect of young children's 
behavior have been concerned with children's racial identifica- 
tion and consciousness of self!??5 with the relative significance 
of Tace, sex and facial expression on the choice of playmates® 


and with children’s perceptions of the social rôles of Negroes’ 


and whites.7.8 
While all of these are fundamental problems, a glance at 
Table I summarizing information on the samples reveals sampling 
Procedures that qualify ones acceptance of some of the generaliza- 
tions on the population groups represented. For example in two 
Teports*? numbers are so small as to make generalizations impos- 
Sible save for the twenty odd children concerned. In four, 
== 
Jlis Du Pont, Willa 
preliminary group 
and to Dr. Rheem 


* Acknowledgment is due to graduate students Phy! 

- Schmidt, Gloria Benson and Barbara C. Johnson for 

Studies, to Dr. Stanley Nash for mathematical assistance, f 

Jarrett and Dr. Harold E. Jones for reading the manuscript. 
385 
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though samples are large for the total study, comparisons for 
subgroups representing skin color, race, socio-economic status 
and segregation are made between such disparate numbers of 
children as nineteen, twenty-one and one hundred,* twenty-four, 
eighty-four and twenty-seven,* ninety and one hundred fifty-two" 
and eighty per cent and twenty per cent of the sample.’ Three 
of the reports are concerned solely with negro children.^?? 
Two? are limited to children of five years and over. Measures 
of significance for differences obtained are lacking completely in 
three reports.?*9 
PURPOSE OF INVESTIGATION 


In planning the present investigation it was, therefore, decided 
to study responses to persons of different skin color by equ 
numbers of children—of both sexes— of three and five years 0 
age—of upper and lower socio-economic status—of the Negro 
and white race—living in a Northern and a Southern State. 

Table II summarizes facts concerning the sample. 
groups chosen for study represent readily distinguishable groups 
available in the population. The ages three and five were 
selected with the thought that three-year-olds would be the 
youngest group from whom coöperation might be obtained. 
study of four-year-olds’ responses is contingent on the difference 
in findings between the three- and five-year-olds. At presem 
data are still being gathered on these groups of children m 
California. | 

Socio-economic status was not made a basis of distinction for 
Negro children because of the difficulty encountered in establish- 
ing criteria with the limited assistance available through $5 
schools. It is, however, the investigators’ hope to study this 
factor later. 

While a comparison of responses of children in mixed group? 
(Negro and white) with those in segregated groups woul ж 
interesting, it was found that mixed groups do not exist in th 
local school system in Berkeley and Oakland. Housing are? 
restrictions appear to be the reason for white or Negro scho? 
with a negligible percentage of children of the other 120° 
attendance. . ter- 

A glance at Table II indicates the type and number ofin 
group comparisons possible with the experimental design 22 
cated by the sample. 


The 


TasLE I.—SamPLES Usep Іх REPORTS OF Youne CHILDREN'S REACTIONS TO DIFFERENCES IN SKIN COLOR 


Number 


Reports Cases 
1 150 


3 140 


5 185 


Socio-Ec. 
Age Sex Race Status 
50 3 yr. 75 male 150 Negroes 5 W.P.A.N.S. 
50 4 yr. 75 female 1 Pvt. N.S. 
50 5 yr. 1 Pub. Sch. 
^ Nos. 
Same as in No. I 
3 yr. 140 Negroes 
4 yr. 
2-9 15 Negroes 
to 12 White 
4-4 
Pre-sch. 57% 20% Negroes 24 White high 
Kind, 43% 80% White 84 White low 
27 Negro low 
23 16 male 7 Negro W.P.A.N.8. 
to 8female 17 White 
5-1 
Kind. 90 Negro Middle and 
First 152 White Lower 
Second 
Grade 
Kind. Middle and 
First Lower 
Second 
Grade 


Group Exp. 
Segregated 


21 Mixed 
19 Semi-segregated 
100 Segregated 


24 White segregated 


28 Negro segregated 
73 Mixed 


Skin Color 
30 light 
66 medium 
54 dark 


14044 y 


ил шә 


qp 10210190 


ubisa 
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PICTURE INSET TEST 


In developing a test situation it was decided that a response 
involving interesting activity would result in readier coóperation 
from the three-year-olds than one calling for verbalization. 
pieture with one figure which could be completed by adding an 
inset containing another figure, offered such a possibility. 


Taste IL—YouNG CHILDREN’S RESPONSES то PERSONS OF 
DIFFERENT SKIN COLOR 
Population Sample 


N-576 
n — 


Age 3 years 5 years 
Race Negro | White | Negro | White 
Unde-| U Unde-| Up- er 
Soc. Ec. St ps ; Low 
Je die fined | per Tower fined | per 
Northern State 
(California) 
Girls 24 | 24 | 24 | 24 | 24 | 24 
Boys 24 | 24 | 24 | 24 | 24 | 2% 
Southern State 
(Alabama) 
Girls 24 | 24 | 24 | 24 | 24 | 2 
Boys 24 | 24 | 24 | 24 | 24 | 4 


Two series of pictures and insets were therefore devised, one 
for boys and one for girls. Each series contains eighteen Ps 
tures. As Table IIT illustrates, in six pictures the picture figu 
is white; in six, brown; in six, black. In four out of each 9'* 9 
these pictures, the picture figure is а child of the same sex a 
the child to be tested; in one out of each six the picture 180. 
is a child of the opposite sex; and in one, a woman. .. ailes 

The figure represented in the accompanying insets 18 ет 
а child of the same sex as the child in the picture, а baby 7 
woman or a man. Each picture has three accompanying ins 


ee ae т 0o 
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om Ill.—Younc CHILDREN’S RESPONSES TO PERSONS OF 
IFFERENT Skin COLOR. PICTURE INSET Sers FOR Boys 


Picture Figure Inset Figure 


Skin Color | White | Skin Color | White | Brown Black 
1A* Boy Boy at bt et 
2A. 2 Baby a b с 
ЗА 2 | Woman a b с 
4А M Man a b с 
5A Woman Man a b c 
6A Girl Girl a b с 

ee ы Шин лс ——. rem d 

Skin Color | Brown | Skin Color | White | Brown Black 
1B* Boy Boy a b с 
2B n Baby a b с 
3B " Woman a b с 
4B 74 Man a b с 
5B Woman Man a b с 
6B Girl Girl a b с 

—_ ——— 

Skin Color Black | Skin Color | White Brown | Black 

———— m | „— m d 
1С* Воу Воу a b с 
2С " Baby a b с 
3C ” Woman a b e 
46 ” Man a b с 
5С Woman Man a b с 
6С Girl Girl а b ç 


* ABC refers to skin color of figure in picture. 
tabe refers to skin color of figure in inset. ч CH 
Note: Figures 1 to 6 refer to picture and inset person-combination, us 


3A— white boy with a woman. 


єз 
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which are identical in all respects except the skin color of the 
person represented. 

Each picture when completed with an inset portrays two per- 
sons engaged in an activity with which any young child would be 


familiar. Activities are playing, eating, bathing, riding, walking 


and waking up in the morning. The pictures are designedly 
neutral in feeling tone in order to be within the comprehension of 
three-year-old children. E 
Construction details concerning the pictures are that they were 
painted with a quick drying lacquer on 12" x 15" masonite 


rectangles and finished with a clear shellac on both sides. Colors- 


chosen were recommended by the University Decorative Art 
Department as being equally pleasing with white, brown and 
black skins. Negro facial characteristics other than skin color 
were suggested but not emphasized. Slight variations in back- 
ground and clothing were made for the six A, B, and C pictures 
and insets so that children might not tire of them. For instance, 
IA shows two boys piling blocks in a wagon; IB, two boys on 2 
rocking boat; and IC, two boys making a sand castle. Figure I 
shows two different picture and inset person-combinations. 
Inset figures are light white in one, black in one and brown 1? 
another inset. 

Between usage pictures were Stored in flannel bags hooked 00 
to a portable storage rack. 


DATA AVAILABLE FROM RESPONSES TO PICTURE INSET TEST 


When the series of pictures is presented on three separat? 
occasions with the three possible pairings of the three insets, 
data are offered on fifty-four choices of an inset for a pictut? 
In thirty-six choices the child has a chance to match the skin 
color of the figure in the inset with that of the figure in the 
picture. The child also has thirty-six opportunities to register à 
preference for white, brown or black skin color as each inset wit 
this skin color is presented thirty-six times as one of a раї fro 
which he makes a choice. 


black, it is obvious that it is also possible to compare such т oe 
ing and preference choices in terms of 3) the different perso 
represented in the inset and 4) in terms of the first and thi 
presentation of the series. 


C A Problem in Factorial Design 391 


392 The Journal of Educational Psychology 


Data from this latter comparison could be taken as evidence 
either of consistency of choice or development of a solving 
principle or hypothesis. 

As a pair of insets necessarily assume a right and left position 
it is also possible 5) to compare—the number of times the child 
shows a preference for or matches the skin color of the figure in an 
inset presented to his right or his left. 

If children’s responses to the picture inset test are to be 
interpreted in terms of matching and preference reactions it is 
necessary that the order of presentation of the pictures does not 
introduce systematic variables and that it is similar for all 
groups of children in terms of the comparisons to be made. 


PRESENTATION FACTORS HELD CONSTANT 

Right-handed choices.—As a preliminary group test revealed 2 
strong tendency of the three-year-olds to choose the inset pre- 
sented to their right it was obvious that for each presentation Ч 
the series of eighteen pictures, white (a) brown (b) and black (6 
inset figures must appear equally often to the child's right and to 
his left and must equally often match the skin color of the figure 
in the picture when presented to right or left. 

Perseveration.—A. tendency to perseverate had also to be 
counteracted by randomising or systemizing the order of pres- 
entation of the skin color of the figure in the picture and tha 
of the figures in the insets. 

Table IV summarizes factors held constant in presenting the 
insets to each group of children. Table V indicates the way 12 
which presentation order of paired insets is developed. Many 
other examples besides the two presented are possible. 

After working out a presentation order for the paired in 
it was next necessary to randomise, or more correctly syste™ 
the order of presentation of the skin color of the stationary figure 
in the picture. Systemization was in terms of having nO ® T 
color follow itself, thus: 


sets 


1A 1B 1C 
2C 2A 2B 
3B 3C OU 
4A 4B 4C 
5B 5С 5А 


—————— ___ 
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Forty-two different presentation orders can be devised which 
meet this requirement. ` 

The next problem was to combine three different picture 
systemization series (one for each presentation) with a set of 
paired insets meeting the requirements exemplified in Table V. 


Taste IV.—Facrors Нюр CONSTANT IN PRESENTATION OF 


54 PAIRS or INSETS 


Matching 
Pres- | Skin color | Number presented possibilities 
enta- | ok figure |. | rr 
ü i 
ion in inset | otal might| Left | Total | Right Left 
Hid [wines | | 9| 9] | 8 
Brown b 12 6 6 4 2 4 
Bade | l e| 6 | ЕИ 


Second | Whitea | 12 6 
Brown b 12 6 
Black c 12 6 


оо о 
геге 
СЕЕ 
ww д 


Third | White a 12 6 6 4 2 2 
Brown b 12 6 6 4 2 2 
Black c 12 6 6 4 2 2 


Total White a 36 18 18 12 
Brown b 36 18 18 12 
Black c 36 18 18 12 


Eighteen matching choices possible on the right and on the left. 

Equal occurrence of each permutation: ab ac be, ba ca cb. 

Each picture matched once on right, once on left. à А 

Each picture and inset person combination presented with a hne 
а brown and а black skinned figure on the right and on the left in eac! 
presentation. 


` Table VI presents a series for one group of cbildren, prepared 
as a check and tabulation sheet. This check sheet 15 being used 
with five-year-old Negro and white children in California and in 
Alabama, 
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Taste V.—Two ExampLEes OF Ways iN Wuicu PAIRS OF 
Insets May Ве PRESENTED. Hoipinc Constant FACTORS 
DESCRIBED IN TaBLE IV 


Key І. 1child with child inset. Key III Right or Left R or L. 
2 child with baby inset. Key ІУ Skin color of central figure 


3 child with woman inset. A, white; B, brown; C, black 
4 child with man inset. Key V Skin color of inset figure 
5 woman with man inset. a, white; b, brown; с, black 


6 child with child inset (other sex) 
Key П Number of presentation I, II, III. 


Picture. i II III Picture. I II II 
RL RL RL RL RL RL 
1A a-b c-a b-c 1A a-b b-c Ce 
2A b-a a-c c-b 2A b-a c-b 8-6 
3A а-с c-b b-a ЗА b-c c-a a-b 
4A c-a — bec a-b 4A cb = ae b-a 
5A c-b Ъ-а a-c 5A c-a a-b b-c 
6A bec ab са бА ас ba cb 
1B с-а b-c a-b 1B b-c c-a a-b 
2B a-c c-b b-a 2B c-b a-c b-a 
3B c-b b-a a-c 3B c-a a-b b-c 
4B b-c a-b c-a 4B a-c b-a c-b 
5B b-a а-с c-b 5B a-b b-c ds 
6B a-b c-a b-c 6B b-a c-b a-c 
1C b-c a-b с-а 1С c-a a-b bo 
2C c-b b-a a-c 2C a-c b-a c-b 
3C b-a a-c c-b 3C a-b b-c ca 
4C a-b c-a b-c 4C b-a c-b a8 
5C a-c c-b b-a 5C b-c c-a a-b 
6C ca — bee a-b 6C cb ac be 
Total Presented Total Presented 
а 66 66 6-6 a 66 66 66 
b 66 66 66 b 66 66 66 
" 6-6 66 6-6 e 6-6 66 66 
Matching Matching 2 
a oo 0% 2-2 * 22 22 2- 
b 2-2 2-2 2-2 b 2.2 2-2 2-2 
E 22 22 22 с 22 22 22 
mutations Permutations 
"e с-а b-c 9 of each b-a а-с cb 90 а 


b-a a-c c-b 9 of each a-b с-а b-c 
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TaAsLE VI 


Young Children's Responses to People of Different Skin Color 


Child's Nane, Age, 


Parent's Occ. Sex, 

Ais cas Skin Соо 
chool School бсош___  —— 
Experinenter, 


[o i -——— 


Preference 
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As six groups of children are to be studied in California and in 
Alabama, five other sets, each of three different systemizations of 
picture skin colors and their accompanying inset pairs, were also 
prepared. 

In combining picture and inset series it was found, to the 
investigator’s chagrin, that it was not possible to assign random 
numbers to the forty-two picture series and the various inset 
series and then combine them. Even though such random 
combinations met all requirements listed on Tables IV and V they 
introduced other problems. In some cases runs of four of a kind 
of skin color of inset figure appeared on the right thus: 


1A ab 

2B cb—4 bs on one side 
3C ab " 

4A eb 


In others there were runs of matching skin colors on one side 
thus: 


Wawra 
c 
& 


It was therefore arbitrarily decided to eliminate all combina- 
tions in which there was a run of four or more of a kind of skin 
colors on the right or the left, or five or more matching skin 
colors on the right or the left. It was thus that the six different 
check sheets, one of which is shown in Table VI were developed 
for the six groups in California and Alabama. 

As an additional measure in overcoming the influence of 
systematic variables in presentation order each group of forty- 
eight children was divided into three subgroups of sixteen, 2D 
given the following presentation orders on the three occasions on 
which they were tested.* 


* This suggestion was offered by Dr. W. G. Cochron. 


сд 
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CO REESE eee 


Occasions 


G 
roups 1 2 3 
Lo КИШЕН deque 


Presentation orders 


X I II ш 
Y II III I 
R ш I II 


MANNER OF PRESENTATION 


All groups in California are being tested by one white experi- 
menter. The series of eighteen pictures, one for boys and one 
for girls, is presented on three occasions, à week apart. Each 
child is tested singly. The procedure takes from five to ten 
minutes for each child. The child is told, in the case of the first 
picture, “Here is a picture of two boys (or girls) playing. One 
of the boys is out of the picture. Which of these boys would you 
like to put in?" The insets are presented above the inset space. 

М At the end of the third presentation the experimenter presents 
six insets of a white boy, a brown girl, a black boy, a white girl, 
a brown boy and a black girl, and laying them in front of the 
child says, “Some of these children are Negroes. Would you 
show me all the Negro children? Put your finger on all the Negro 
Children," 

" The purpose, here, is to obtain data which may be of interest 
in comparing children's responses to persons of different skin 
color in terms of their expressed awareness of its valid significance. 

'The experimenter then tests the child's ability to match skin 
color by presenting three rectangles painted with samples of 
Skin color. 


ba cb ac 
a b 

ab ba cb 
a b с 


She points to the опе in front of the child and says, “Show me 
the one like this. 


the one like this. Put your finger on 
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In summary the test procedure devised for determining young 
children’s responses to persons of different skin color holds con- 
stant all presentation factors which preliminary trials indicated 
might affect the results. Differences in response between groups 
of children may therefore be interpreted in terms of native, 
developmental and environmental factors. Р 

A report presenting and discussing the responses of the SIX 
groups of children tested in California is now in preparation. 
The six groups of children in Alabama have not yet been tested. 
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INSIGHT INTO ONE’S OWN VALUES* 


JULIAN C. STANLEY 
George Peabody College for Teachers 


Twenty years have elapsed since Vernon and Allport!” first 
published an attitude scale, A Study of Values, designed to 
validate Eduard Spranger’s'* six ‘types of men’ empirically. 
Except for its social-value scores, which are quite unreliable, the 
Instrument has proved to be useful in many fields, particularly 
for comparing groups. A considerable amount of normative 
data showing characteristic patterns for various occupations 
and institutions has appeared in the psychological literature. 


SELF-RATINGS 


One aspect of validity, correlation of self-rankings with scores 
on the scale, has received comparatively little attention. In 
their original article Vernon and Allport? reported r's between 
Scores and “the average of five external and one self-rating” 
for each person in “а fairly heterogeneous group " of forty-eight 
College students (pp. 245, 242). These are shown in Table 1. 

Two years later Pintner!? obtained correlations with self- 
ratings for one hundred eighty-seven students in an educational 
Psychology class (fifty-eight men, one hundred twenty-nine 
Women), which also appear in Table 1. He concluded, “With 
the exception of political interests, all these values are positive 
and some are very satisfactory considering the unreliability of 
the self-ratings” (p. 356). 

Recently Anderson? studied self-rankings of two hundred eight 
male vocational counseling clients “ргіог to the interpretation 
of their results on the Allport-Vernon Study of Values” and after 
these individuals “were given an explanation of the six directions 
of interest represented in this measure” (p. 350). Subjects did 
not rank all six values, but instead indicated “ће two among the 
six values which they judged to be most significant to them 
and “the two among the six values which they judged to be 
— 

* The writer is indebted to Doctors Gordon W. Allport, Susan W. Gray, 
and John W. Gustad for suggestions that proved helpful to him in reporting 


the results of this study. 
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least significant to them” (p. 350). Нег analysis of this data is 
couched in terms of percentages rather than correlation coeffi- 
cients, so no direct comparison with the above studies is possible. 
The general trend seems to be essentially the same, however. Of 
particular interest is her finding that self-understanding appar- 
ently increases with age, the 26+ group exceeding the 18-25 
clients. Е 


TABLE 1.—CoRRELATION BETWEEN SELF-RATINGS AND STUDY OF 
VALUES SCORES IN THREE ÍNVESTIGATIONS 


Value 


Study Theo-| Eco- | Aes- ‚| Po- |Relig- 
retical | nomic | thetic Social litical | ious 
|. 
Pintner!? 31 | .39 | .59 | .14|—.02| -68 
Vernon and 
Allport!" .40 | .57 | .57 |—.06| .44| -69 
This Study .З1 | .51 | .51 .15| .24 


Although the SV* is a forced-choice instrument which indicates 
the strength of the six evaluative attitudes relative to each othe 
apparently the rating scales used by Pintner!? and Vernon 27 
Allport did not employ a ranking technique, but instead allow? 
the subject to rate himself high (or low) on every value if he 8° 
desired. Self-ranking without ties seems to the present writer 
more in harmony with the rationale of the SV than are DO7- 
complementary ratings. Also, untied ranks make feasible the 
computation of Pearson product-moment r's between scores ар 
self-ranks for each individual, because certain constants сал. 
inserted in the usual formula for the correlation coefficient with 
ensuing simplifications. This technique was employed in 
present study. 


SUBJECTS AND METHOD 


; : ; jve 
The subjects were sixty-six male freshmen taking an electi 
course in general psychology at a small New England municlP 


———^ а 5 Verno? 
* Throughout the rest of this paper ‘SV’ will refer to the Allport- 


Study of Values. 


аз 
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junior college. "They comprised about fifty per cent of all male 
freshmen at this institution and were reasonably representative 
of that group. The age range was 17-25 years, with a mean of 
20.0 and a standard deviation of 1.8. 

‚Оп a Monday during the second semester each subject was 
given an SV booklet and allowed to complete it in class. The 
scale was not discussed until the next Monday when the writer 
suggested that self-ratings be made and when he read to the 
group the outline of Spranger’s types from pp. 8-11 of the Manual 
of Directions! without additional comments. Every person was 
then asked to rank himself without ties from 1 (highest value) 
to 6 (lowest value) on the categories. Only after these rankings 
were collected did students learn their scores. 

, Both Scores and rankings were secured for sixty-six of the 
sixty-eight men enrolled; two were absent when students ranked 
their. values. Complete data were obtained for all twelve 
female members of the group, but because of the small number 
involved these results have not been included in the present 
report.* 

RESULTS 
Scores and Self-Rankings.— Table 2 summarizes SV scores for 
these sixty-six male freshmen, who were highest on political and 
economie values and lowest on aesthetic. Their profile is fairly 


TABLE 2.—MEANS AND STANDARD DEVIATIONS OF Srupy OF 


Vanuzs Scores ғов 66 MALE COLLEGE FRESHMEN 


Value 
T E A S 
Mean 29.3 | 32.0 | 23.7 | 30.3 
SD 611 €8| 7-6| 5.0 


s reported in the Manual of 


Similar to the typical one for male 
Directions. > 
Information concerning self-rankings is given 10 Table 3, 


where the highest average rank, 2.6, is on the social category and 


* Their self-ranking correlations did not, however, differ markedly from 


those for the men. 
е 
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the lowest, 4.6, is on the religious. Correlating score means with 
rank means produces an r of only .15,* so for the group as а 
whole there was poor agreement. If, however, we compute the 
correlation between scores and ranks separately for each value, 
the r’s are somewhat higher (see Table 1). These figures agree 
fairly well with those of Pintner!? and Vernon and Allport," 
even though Pintner (and perhaps Vernon and Allport, also) 
employed both sexes and should therefore have had more score 
variability and a consequent tendency toward larger 7's than in 
the present investigation. 


TABLE 3.—MEANS AND STANDARD DEVIATIONS OF SELF-RANK- 
INGS ON STUDY OF VALUES CATEGORIES ron 66 MALE COLLEGE 
FRESHMEN 
(1 = highest rank, 6 = lowest) 


Value 


Individual Correlations.—Sixty-six correlation coefficients were 
computed, showing for each subject the relationship between his 
scores and ranks, and the median value was found to be -39, 
with a range from .98 to —.81. Since the distribution of these 
individual 7’s is negatively skewed, it was thought desirable to 
employ Fisher's! z-transformation with the correction for system- 
atic positive bias (p. 205). In Table 4 will be found a distribu- 
tion of the corrected z's as recommended for graphic portrayal 
by Kelley. The mean z computed from ungrouped data }8 
.369, to which corresponds ап т of .35. The difference betwee? 
this mean z and a 2 of 0 is more than five times its standard error. 
The sample standard deviation, .54, approximates the theoretic? 
standard error of а z based upon six pairs, 1/4/3 = .58. 


* Because the highest rank is 1 and the lowest 6, negative coefficients of 


"correlation between ranks and SV scores have a positive meaning in а ‘high 
ranking goes with high score' sense (and, conversely, r's that are initially 
e have a negative connotation). Therefore, in this study all 7 


itivi з А 
s d scores have been multiplied by — 1 before being reporte 


between ranks an 
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Intra-individual variability, represented by the standard 
deviation of the subject’s SV scores, correlates .38 with the z's, 
showing in this study a significant though slight tendency for per- 
sons with the more pronounced value patterns to rate themselves 
better than do those with less dispersion. Inspection of the 
scatter diagram for this r reveals that the regression is probably 
rectilinear. 

Reliability —Vernon and Allport*? listed split-half reliability 
Coefficients based upon their ‘fairly heterogeneous group’ of 
forty-eight college students but did not indicate the methods of 
splitting employed. Careful scrutiny of the SV score sheet shows 
that a split producing forms comparable with respect to content 
Шш уегу difficult, if not impossible, to secure. A simple odd-even 
division of the present data resulted in the following critical 


TABLE 4.—Frequency DISTRIBUTION оғ 66 CORRECTED 2'5 


(i = .41) 
ima r Equivalent Fre- 

Class Limits Class Index of Class Index | quency 

EM o ee 

1.85 & 2.25 2.05 .97 1 
1.44& 1.84 1.64 93 1 
1.03 & 1.43 1.23 .84 0 
-62& 1.02 82 .68 28 
21& .61 41 .39 15 
— .20& .20 0 0 16 
— .61& — .21 = „Дїй — 289 8 
—1.02 & — .62 — .82 — .68 1 
—1.48 & —1.03 51.99 — J84 1 


ratios for the differences between means of the halves: theoretical, 
08; economic, 7.2; aesthetic, 4.6; social, 3.7; political, 2.1; and 
religious, 4.1. All but one of these CR’s are significant beyond 
the five per cent level, so the halves do not fulfill the assumption 
of equal means set forth by Jackson and Ferguson" (p. 110). 
Nevertheless, for comparative purposes тп’ determined from 
these halves* are shown with the Fisher and Vernon-Allport 
_——— 

* Instead of computing the т between sc 
uu ing this up’ by means of the Spearm& 
mployed Rulon's! simplified procedure. 


ores on the two halves and 
n-Brown formula, the writer 
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coefficients in Table 5, where it will be seen that with the excep- 
tion of the political value all of the present figures are lower than 
those reported in 1931. This may perhaps be attributable in 
part to the heterogeneity, especially with respect to sex, of the 
earlier group. 


TABLE 5.—STEPPED-UP SPLIT-HALF RELIABILITY COEFFICIENTS 
For THE Study of Values OBTAINED IN THREE DIFFERENT 
А INVESTIGATIONS 


Жыш REISEN ERES 
Fisher:* 
Fathers .50 1. .64 .45 .48 -75 
Mothers .65 | .60 | .39 | .57 | .43 | -75 
Sons .49 | .72 | .81 | .59 | .58 | -74 
Daughters .69 | .64 | .62 | .58 | .37 | -76 
Vernon and 
Allport? .62 | .72 | .84 | .49 | .53 | -34 
This Study 45 | .64 | .78 | .o1 | .72 | -46 


Harris? Todd, and Whitely!5 report substantial test-retest 
r’s even for the social value, so the low split-half coefficients 
found in the present study can probably be charged in some 
measure to the method of splitting and to error variance in the 
academically mediocre group of freshmen taking the test. The 
entire SV scale is quite short, however, so reliability coefficients 
for each of the six categories cannot reasonably be expected е 
be high enough for individual predictive purposes. 


DISCUSSION 


Vernon and Allport’ remark that “Empirical validity cannot 
be found satisfactorily by comparing the test results with rating® 
owing to the unfamiliarity of the average rater with the con 
ceptual nature of the values. His misinterpretation of the ds 
value, combined with the ambiguity inherent in Sprang g 
conception of this value, is fatal" (p. 245). Pintner's? subje 
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misinterpreted the political category (direct expression of power) 
even more than the social. 

Most available evidence seems to indicate that the social 
category lacks reliability. The political value is reasonably 
reliable but sometimes exhibits quite low correlations with 
ratings. In a personal communication to the writer, Dr. Allport 
remarked concerning these observations and others: “И the SV 
has high validity (and it seems to have) but if self-ratings are 
relatively poor against this criterion, does it not follow that 
students require an opportunity to get better insight? In 
other words, the SV is a good didactic device. What students 
need is to compare themselves with their contemporaries on à 
common scale. Until they do so their self-knowledge is defi- 
cient.” With this point of view the present writer concurs fully. 
. The z's probably have rather low reliability, but this con- 
jecture has not been tested in the present study. Such a deter- 
mination would involve two administrations of the SV to each 
Subject, followed by two sets of self-rankings for each person, 
and would also permit computation of an ri: for the ranks. 

If z is an estimate of the subject’s self-insight into his value- 
System as defined by Spranger, what characteristics should 
persons with high z's have that differentiate them from those with 
low z's? We might surmise that the former individuals would 
react more objectively to their environments, rationalize less, 
and in general be better adjusted. They should not necessarily 
be superior students, however, since the insightful individual 


' Whose highest value is, say, economic, may be content barely to 


Pass his work in order to meet minimum standards for a degree 
that willhave monetary worth forhim. Infact, none of the values, 
with the possible exception of the theoretical one, which resembles 
Thurstone’s'® ‘interest in science,’ seems logically related to 
desire for general academic success. ideni 
Since good reading ability appears to be necessary in order to 
fill out the SV intelligently, and since understanding the descrip 
tion of Spranger's types as set forth in the Manual of Diree AM 
calls for considerable knowledge of vocabulary, the pd y 
that the z's are positively associated with scores on ® ie ae 
test was investigated. Ther between 2?8 and total scores on ^ 2 
Nelson-Denny Reading Test, which is speeded and Sac 
both vocabulary and paragraph-comprehension subtests, er 
only .10, while the z's correlated .14 with scores on the Revise 


e 


406 The Journal of Educational Psychology 


Minnesota Paper Form Board Test,” an essentially nonverbal 
measure of spatial-relationship ability.* Neither of these 7’s 
differs significantly from zero, of course. 

Vernon and Allport’? point out that intra-individual varia- 
bility is one measure of the reliability of profiles on the six values. 
For poor readers the scale probably should be less reliable than 
for those who read better, so we might expect moderate positive 
correlation between individual o’s and scores on the Nelson- 
Denny Reading Test, but this r is just .10. Evidently the 
range of reading ability among these subjects is not great enough 
to affect intra-individual variability very much. 

Future Research—Both z's and individual o’s seem worthy 
of further study, especially with reference to personality vari- 
ables. It would be helpful to know, for instance, how self- 
insight as measured by z varies from the freshman to the senior 
year of college and what change occurs іп с during that interval. 
A carefully planned longitudinal investigation would be needed 
to follow up Anderson's? observation that self-insight appears io 
increase markedly with age. On a priori grounds possibly we 
should hypothesize that both z and с are thus related to chrono- 
logical age. It is not sufficient to establish that in a given group 
significant correlation exists between z's and age, because 
older persons may differ considerably from the younger one 
many respects other than age.[ For example, we cannot safely 
assume that when fifty-year-olds in such a group were twenty 
their 2’s would have been of the same magnitude as those of the 
current twenty-year-old subjects. s 

Among students in the present study, as in most such school- 
grade situations, age is negatively correlated with tested intel- 
ligence. If both chronological and mental age are positively 
correlated with z, some eighteen-year-olds may be able to coni 
pensate for youth with brightness and therefore earn higher ? 4 
than older classmates. Furthermore, practically all of the olde 
students are World War II veterans, while few of the young’? 
ones have had such military experience. These factors pom 
toward the necessity for following the same persons throug 
college and, preferably, into later life.{ 


sin 


774 The r between NDRT and RMPFBT scores for this group is -35- eh 
fFor the relatively homogeneous group utilized here, the 7 betw 
chronological age to the nearest year and z is .14. 
[Кога thorough discussion of this general point see Corey.* 


la 


A 
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Statistical Note.—Peters and Van Voorhis! call the т between 
Scores and ranks rho prime and state that Pearson's correction 
formula for estimating the r that would have been obtained if 
Scores instead of ranks had been availableisr — 1.0233p’ (p. 109). 
Since this adjustment is small and depends upon an untested 
assumption, it was not made in the present study. 

à The mean of six untied ranks is 3.500 and the standard devia- 
tion 1.708. The mean of an individual’s SV scores is always 
30.000, so the customary formula for the product-moment coeffi- 
cient of correlation may be simplified for our purposes to 


630 — EXY 
4.18 V ZY? — 5400 


Where X designates any rank and Y any SV score. It will be 
noted that because a rank of 1 is ‘high’ and 6 ‘low,’ we have multi- 
plied the usual formula by —1 in order that a tendency for high 
ranks to go with high SV scores will result in a positive coefficient. 


SUMMARY 


After reviewing the brief literature dealing with self-rating on 
the Allport-Vernon Study of Values, the writer discusses a study 
involving self-rankings without ties made by sixty-six male col- 
lege freshmen. For individuals the average correlation between 
these ranks and SV scores was approximately .35. In the group 
as a whole social-value scores correlated lowest with self-rankings 
(15), while aesthetic, economic, and religious values were highest 


and tied with .51. 


In this investigation there is a slight tendency (r = .38) for 
Students whose values are pronounced to have better ‘self- 
insight? than those whose profiles are relatively flat. 4 

A measure of insight called 2, which can be computed fairly 
quickly with the assistance of an electric calculator, i$ offered 
for further study, especially with regard to its reliability and 
validity. 

Some measure of intra-indivi 
ard deviation is suggested for inclusion 
involving the Study of Values.* 
= 

* Since this paper was written, Allport ап 
ачта the SV, giving particular atten 
actory social scale. 


dual variability such as the stand- 
in future research projects 


d Lindsey have "revised 'and 
tion to the hitherto unsatis- 


e 
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METHODS FOR INDICATING THE TRUE SIZES 
OF PICTURED OBJECTS* 


MORTON 8. MALTER 
Michigan State College 


Textbook illustrations may depict objects in enlarged, actual 
or reduced sizes. Occasionally, related objects similar in size 
are reduced by the same proportions and illustrated in one panel. 
Readers familiar with one object can then use it to judge the 
sizes of the others. More often no attempt is made to reduce 
objects by the same ratios because they are too diverse in size. 
For example, an elephant might be reduced in a ratio that would 
result in an adequate sized illustration. To reduce other objects 
similarly would result in exceedingly small representations. 
Likewise, the attempt seldom is made to enlarge items by the 
same proportion. Furthermore, within many books some objects 
necessarily are enlarged or reduced, while others lend themselves 
to reproduction in actualsize. The result is that readers seldom 
have an opportunity to utilize familiar pictures in evaluating 
the actual sizes of unknown representations. 

To guide readers in judging the actual sizes of representations, 
captions are used. These captions sometimes indicate actual 
Size in ratio form, e.g. “14 actual size.” Ratios are unacceptable 
to most educators for they generally are difficult to interpret. 
More often the captions are in terms of linear measurement, 


-@g. “The object is 5 feet long.” Although this type of caption 


is assumed to be useful for adults, some educators have ques- 


tioned its validity for younger pupils. They would prefer, - 
instead, that the size of a pictured object be shown through 
Comparing it to a familiar item. Dale,’ for example, states: 
“Unless the picture includes one item whose dimensions are 
familiar to students, it will be impossible for them to knon en 
sizes of the objects. A good photograph of the pyram 
includes a man or a camel, and immediately the child appreciates 
the relative sizes. It is not enough to tell pupils how large the 
items are... . ” 
ee 


! This study was subsidized in part by а grant from Britannica Jr. 
?Edgar Dale, Audio-Visual Methods in Teaching, New York: Dryden 
Press, 1947, p. 230. 
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This writer could find no studies concerned with the ability of 
pupils to utilize either linear measurement or familiar objects 
in judging the sizes of unknown representations. This study, 
therefore, was conducted to determine the relative effectiveness 
of these two methods. The study is limited to pupils in grade 
VI. 16 involves only illustrations whose referents range between 
six inches and six feet. The illustrations, furthermore, are 
limited to animals reduced by varying proportions. 


PROCEDURE 


For purposes of the experiment, the following null-hypothesis 
was formulated: Numerical terms (linear measurement) are not 


TABLE I.—Tur FOURTEEN ANIMALS REPRESENTED IN PICTURES 


Picture " 
Number Name Geographie Habitat True Size 
1 Adjutant Bird India, Africa 5 feet 

2 Magpie Western U.S.A. 20 inches 
3 Тарі Asia 314 feet 

4 Wart Hog Africa 2714 inches 
5 Flamingo S. America 
Cen. America 4 feet 
6 Flycatcher U.S.A. 14 inches 
5 Yak Asia 6 feet 
8 Horned Toad Western U.S.A. 
Mexico 6 inches 
9 Flying Fish Tropical Waters 18 inches 
10 Aardvark Africa 5 feet 
11 Marten U.S.A., Europe 18 inches 
12 Civet Cat Asia, Africa 244 feet 
13 Barracuda Tropical Waters 3-8 feet 


14 Gila Monster Western U.S.A. 2 feet 


significantly more useful than familiar objects for helping pupils 
in grade VI judge the actual sizes of unknown representation Я 
The hypothesis was tested as follows: a ile 
Fourteen pictures of animals were selected from a juve? à 
encyclopedia. (Table I.) The pictures were submitted Rr 
group of grade VI pupils who were asked to identify each ріс ta 
The results indicated the pupils were unfamiliar with each © 


Indicating the True Size of Pictured Objects 411 


fourteen animals. Pupils tested in this preliminary survey were 
selected from populations similar to those the writer planned to 
use in the experiment. It was assumed, therefore, that the 
fourteen animals represented unfamiliar animals. These fourteen 
drawings were designated as Set No-Help. 

A pair of silhouettes was inserted in the right-hand corner of a 
Copy of each drawing in the Set No-Help. One member of each 
pair represented the central animal in the drawing proper. The 
other member represented a common object, i.e., a man, an arm 
Or a fork, drawn to scale and intended to indicate relative size. 
lt was assumed that the silhouette device would simulate a 
drawing proper including a familiar object. In fact, the sil- 
houette device was probably more advantageous, since the 
possibility of perspective confusing the reader was minimized 
through placing both objects in the pair on the same plane. 

_ The silhouette devices in pictures 1-9, 11 and 13-14 were 
intended to be of maximum value to the pupils. In these twelve 
sets the familiar objects’ most familiar dimension, e.g., the height 
of man, was inserted parallel with the dimensions of the animals 
the pupils were expected to judge. Furthermore, in these sets 
the sizes of the familiar and unknown objects were not divergent. 

1 pictures 10 and 12 the familiar objects were represented 
vertieally, although pupils were expected to estimate the hori- 
zontal dimensions of the animals. In picture 12 the familiar 
object was much larger than the animal. These fourteen draw- 
ings were designated as Set Silhouette-Help. 

Copies of each drawing in Set No-Help were used to prepare 
a third exhibit. This time the size of each animal was indicated 
by a linear measurement caption inserted beneath each picture. 
The captions were taken exactly as stated from the juvenile 
encyclopedia containing the original drawings. The last eps 
in Table I shows the numerical caption included with jm 
иы, These fourteen drawings were designated as Бе 

umerical-Help. 

Sufficient sn of each of the three sets were оази 
to provide proper materials at the desk of each member du 
im being tested. All factors in the drawings Proper w 

ept constant in lanographing process. р Ж 

A desk chart oe bcm as follows: A line measuring 


h 
ten and one-half inches in length was placed on paper. ipe 
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line was marked off and numbered in eighty-seven equally 
spaced places. Each number was inserted twice to enable one 
to read the numbers when the chart was held either vertically 
or horizontally. The desk chart was then planographed. 

A vertical wall chart, measuring eleven inches across and 
one hundred four inches in height was designed. The chart 
was marked off every four inches in numbers from 101 to 127. 
Number 101 appeared four inches from the bottom of the chart 
and the remaining numbers followed consecutively upwards. 
A horizontal wall chart of the same dimensions was likewise 
constructed. This chart was marked off every four inches in 
letters from A at the left to Z at the right. The letter A was 
inserted four inches from the left-hand margin. The markings 
on both charts were sufficiently legible to be read from all parts 
of a typical classroom. 

A multiple-choice test was constructed on the basis of a pilot 
study conducted in three Grade VI classes. Pupils in the pilot 
study responded to the fourteen drawings in the same manner 
described later in this study. Their free responses were used to 
develop the items for the multiple-choice test. The item 
developed in connection with each picture is shown in the 
column marked ‘Choice’ in Table II. The following section 
describes how the multiple choice test was used along with the 
drawings, desk chart and wall charts in collecting the data. 


COLLECTING THE DATA 


The method of administering the materials is considered for 
Class 1, a Grade VI class in Illinois. On a designated date, 
the investigator took charge of the class, consisting of twenty- 
four pupils. The vertical and horizontal wall charts were sus- 
pended in front of theroom. The pupils were divided at random 
into two groups. All pupils were given a desk chart, multiple 
choice test, and the fourteen drawings in Set No-Help. They 
were given the following directions: 


Look at Picture 1. It is a picture of a bird. Notice that the bird 
ig standing on the ground and that the top of its head is marked off m 
dash lines. I want you to imagine how tall the bird is in real um 
between the part touching the ground and the part marked off in das A 
Next, look at the wall chart marked off in numbers. I wa? 


one hat the bird, in real life, is standing against the wall 


you to imagine 6 


> „11е УУУУ ые. н аса. 2 pen 
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TABLE II.—Numper or Puris іх Each GROUP SELECTING 
СноїсЕз ror Елсн PICTURE 


Pic- 
ture Choice 
1 а) 103 
b) 106 
о) 109. 
d) 112 
*e) 115 
f 115+ 
2 a)— 34 
b) 34 
c) 103 
*d) 105 
e) 107 
f) 109 
3 a) 103 
*b) 109 
€) 115 
d) 118 
е) 121 
f) 1214- 
а) 105 
*b) 107 
c) 109 
d) 11 
€) 113 
f 113+ 
2)—109 
b) 109 
*о) 112 
d) 115 
е) 118 
f) 121 
2)—103 
*b) 103 
€) 105 
d) 107 
е) 109 
f) in 
a) 106 
b) 109 
€) 112 
d) 115 
Mo) TIS 
f) 118+ 


* 
Correct Answers 


Inches Num.H. Sil.H. 


12 


2 


0 


2 
"oon 


ew 
mocoso 


Pic- 
ture 
8 


10 


11 


12 


13 


14 


Choice 
a) 18 
+b) 51 
ce) С 
d D 
e E 
£ B+ 
2)—08 
b) 68 
*) D 
d) F 
е) H 
f) J 
a) C 
b) F 
c) I 
*d) О 
е U 
i Ws 
а) —51 
b) 51 
ж) D 
а G 


Inches Num.H. Sil.H. 


2 16 10 
6 35 42 
12 18 17 
16 6 2 
20 0 3 
204- H 2 
E 6 6 
8 7 7 
16 23 12 
24 22 25 
32 8 19 
40 10 7 
12 0 5 
24 1 6 
36 9 23 
60 360 21 
M yo s 
м 4 YN 
- E y 
6 4 2 
16 29 11 
28 20 35 
36 15 18 
48 4 3 
-6 4 7 
6 6 14 
12 6 20 
24 47 29 
48 1 5 
60 2 1 
6 3 5 
12 0 1 
24 1 4 
60 39 38 
96 18 34 
96+ 5 4 
-8 1 1 
8 5 8 
6 9 6 
12 9 10 
24 42 38 
48 10 18 
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chart with its feet on the ground. Now look at the multiple-choice 
test. Notice that there are six choices under the part marked Picture 1. 
The choices are marked a, b, c, d, e, and f. Here is what the choices 
mean. Choice “а” means the bird shown in Picture 1 would reach 
to number 103 if it were standing against the wall chart. Choice “b” 
means that the. . . . 


Similar directions were given for Picture 2, which involved 
using the desk chart and vertical wall chart. After explaining 
the directions for Pictures 1 and 2, the investigator found the 
pupils were able to proceed on their own in judging the sizes of 
the remaining animals. A number of pupils requested individual 
attention at their desks. Among the questions raised were: 
1) *Between which two parts of the animals do I estimate real 
life size?" 2) "How do you use the multiple-choice test?" 
3) “Do we imagine the animal is standing on the floor or on 
No. 101?" The writer is convinced that his answers clarified 
the questions. 

When all subjects had completed the test, the drawings and 
multiple-choice sheets were collected. Blank multiple-choice 
sheets were given again to all pupils. Twelve subjects selecte 
at random were given Set Silhouette-Help; the remaining SU?" 
jects were given Set Numerical-Help. All pupils were aske 
again to estimate the sizes of the animals, utilizing the help 
provided with the drawings. The subjects were aware only of 
the help provided with their particular set, since the groups 
previously had been placed in different parts of the room. The 
pupils experienced no difficulty in following the directions. 

The fact that subjects in the groups were seated at varying 
distances from the wall chart was discounted as unimporta? 
to the experiment on the basis of two assumptions. First, the 
assumption was made that equal numbers of pupils in both 
groups would be seated at the same distance from the wall chart. 
Secondly, the factor of size constancy was assumed. The term 
‘size constancy’ is used to refer to the fact that the seen sizes © 
object do not diminish as they become more distant, as do tbe 
retinal images corresponding to these objects. In this instance 
the ‘seen sizes’ of objects refers to distances on the wall chart, 
against which the subjects had projected mental images of th 


animals. vi 


Data were collected in a like manner from five other Grade 


Es zx. 
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classes, making a total of one hundred fifty-four pupils tested 
in the experiment. The IQ of the seventy-six pupils provided 
with Set Silhouette-Help was 103.26 (¢ 11.17); their CA was 
139.79 months (c 7.34). The IQ of the seventy-six pupils pro- 
vided with Set Numerical-Help was 103.73 (¢ 11.09); their 
CA was 140.56 months (е 9.12). 


TEST RESULTS 


To test the formulated hypothesis, only the second multiple- 
choice papers submitted by all pupils were utilized.? Data on 
these papers were analyzed in three ways. First, each paper 
in both groups was marked according to number correct. There 
was only one correct choice allowed for each test item with the 
exception of number 13 (Table II) This animal ranged 
between sixty and ninety inches according to the caption, and 
both choices ‘q?’ and ‘e’ were considered correct. The lowest 
and highest score that may have been assigned to any paper 
Were 0 and 14. The mean scores for the pupils using Set Numeri- 
cal-Help and Set Silhouette-Help were 7.18 and 6.88, respec- 
tively. The significance of the difference between the means of 
the two small samples was computed andt = 1.15. For c df. 
a of this value may have occurred by chance variation between 
twenty and thirty per cent of the time. Thus, the hypothesis 
that the numerical terms are not significantly more useful than 
familiar items in helping pupils in Grade VI judge the true sizes 
9f unknown representations was accepted with a reasonable 

“amount of confidence. 

In the ¢ test Just described only one correct choice was assigned 
to each individual item. The writer realized, however, that 
More than one choice could be scored as reasonably correct. 

Ог example, the Adjutant Bird in Picture 1 is designated as 
five feet tall, but this figure is only the mean of a normal dis- 
tribution, Choices ‘d’ (three feet), ‘е’ (five feet) and ‘f’ (five 
cet plus) are reasonable, and pupils arbitrarily could be given , 
en 


* The first multiple-choice paper was used to determine whether the 


Aumerica] terms and silhouette devices helped pupils judge the actual sizes 
of pictured objects. 


th E The results showed both methods significantly helped 

t 9 Pupils. See Morton 8. Malter, The Relationship of Certain Variables 

ae ae Ability to Estimate the True Size of Pictured Objects, (Unpub- 
e », 


University of Chicago, Chicago, Ill. 
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credit for marking them. As a second means of testing oy 

formulated null-hypothesis, the percentages of pupils in еж 

group reasonably estimating the true size of each pictured objec 
mpared. 

© kenn this comparison, a formula developed Бавио 

for calculating the statistical significance of the difference (0) 

two non-correlated percentages were used. Table III designates 


TABLE III.—PrncENTAGES OF PUPILS IN Grours REASONABLY 
ESTIMATING THE TRUE 81285 or THE DESIGNATED PICTURES 


Reasonable Numerical Silhouette 01. 
Picture Estimates Help Help Probability 

1 def 83 93 = 

2 d 28 41 wm 

3 b 75 ‚91 х 

4 abe 77 84 

5 bed 80 86 FI 

6 ab 62 61 

7 def 75 79 = 

8 b 46 55 a 

9 ed 59 49 WE 
10 d 47 28 x 
11 ed 64 60 T 
12 d 62 38 x 
13 def 82 87 xa 
14 de 67 63 d 


whether or not the differences between the various pairs of 
percentages were significant at the one per cent level of con- 
fidence. Thus the silhouette device in Picture 3 seems to Þe 
more useful than the Corresponding caption (5 feet). The 
numerical terms under Pictures 10 and 12 seem to be more usetu 
than the corresponding silhouette devices. This finding 28 
expected in view of the manner in which the silhouette devices 
in Pictures 10 and 12 were constructed. None of the differ- 


‘Quinn McNemar. “Note on the Sampling Error of the Dies 
between Correlated Proportions or Percentages,” Psychometrika, хи (1947) 
153-57. 


s 
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ences between the other pairs of percentages were statistically 
Significant. One may conclude that, in general, the Numerical- 
Help and Silhouette-Help methods are not significantly different 
With respect to providing pupils in Grade VI with a reasonable 
idea of the true size of à pictured object. . 

The data so far have been analyzed from two standpoints. 
On the basis of the results it was concluded that the two methods 
did not differ significantly with respect to communicating either 
4 correct or reasonable idea of the true size of a pictured object. 
The data were treated in a third manner to determine whether 
9r not the methods varied significantly with respect to affecting 
all choices pupils made on the multiple-choice test. All choices 
are now under consideration, whether or not they are correct or 
reasonable. А 

The chi-square was computed for each contingency table dis- 
tribution listed in Table II. Table IV lists the picture dis- 
tributions according to numbers and the corresponding prob- 
abilities. The chi-square for distribution 1 is 12.94. For 3 df. 
a chi-square of this value would be exceeded much less than 005 
of the time. An aggregate chi-square computed for the test in 
Seneral was found to be 84.47. For 28 d.f. a chi-square of this 
value (or larger) would be exceeded much less than .01 of the 

ime. One may conclude, therefore, that the two methods do 
ffer significantly with respect to affecting the estimates pupils 
make of the size of pictured objects. 

Tbis latter conclusion must be interpreted cautiously. By no 
Means does the conclusion imply either of the two methods is 
better, Nor does it imply that the entries in the adjoining 
Correct cells are significantly different. It does indicate that 
entries in certain of the adjoining cells in the various contingency 
tables did vary significantly. Table IV suggests that the dis- 
tributions demanding our inspection are 1, 2, 4, 5, 10 and 12. 

Examination of distributions 1, 2, 4 and 5 (Table II) suggests 

© pupils in the Numerical-Help Group and Silhouette-Help 
“ТОйр were slightly underestimating and overestimating respec- 
tive ly. Part of this finding is corroborated elsewhere by the 
Writer, who found that pupils in Grade VI tend to underestimate 
Pumerical terms of considerable length, e.g., more than three 
Ss 


* Malter, op. cit., p. 112. 
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feet. The fact that the distributions for Pictures 10 and 12 
were significantly different again was expected. The silhouette 
devices in these two pictures were purposely constructed in & 
manner considered perverse, and thus the entries in correspond- 


TABLE IV.—OCnur-sQUARES AND CORRESPONDING PROBABILITIES 
ом PICTURE ITEM DISTRIBUTIONS or THE NUMERICAL HELP 
AND SILHOUETTE HELP Groups 


Chi- 
Picture Category Square df. Probability 

1 (abc)-d-e-f 12.94 3 .005 

2 (ab)-c-d-(ef) 28.38 3 .004 

3 (ab)-(edef) 1.50 1 .200 

4 a-b-c-(def) 11.68 3 .009 

5 (abc)-d-(ef) 18.72 2 .004 

6 a-b-c-(def) 5.24 3 .157 

7 (abc)-d-e-f 2.62 3 .460 

8 a-b-c-(def) 2.04 3 ‚565 
m (ab)-c-d-e-f 8.66 4 ‚715 
10 (abe)-d-(ef) 18.60 2 .001 
H (ab)-c-d-(ef) 12.34 3 .064 
12 (abc)-d-(ef) 18.28 3 .004 
13 (abc)-d-(ef) 1.64 2 .452 
14 (ab)-c-d-e-f 1.86 4 ‚757 


ing cells in the Numerical Help and Silhouette columns Were 
extremely divergent. 


CONCLUSIONS AND IMPLICATIONS 


The results indicate there is no significant difference in the 
effectiveness of selected familiar objects and numerical terms 
for communicating to pupils in Grade VI the actual size 0 
unfamiliar representations, Pupils in this grade are sufficiently 
acquainted with the meaning of linear measurements ranging 
from six inches to six feet to use them effectively. The pupils, 
of course, varied in ability to assign a correct interpretation to ® 
specified measurement. However, they also varied in ability 40 
interpret correctly designated familiar objects. An implicatio ^ 
is that publishers of Grade VI materials need not insert familia” 


- 
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objects in pictures to indicate the sizes of unknown items ranging 
between six inches and six feet. Numerical terms suffice for 
this purpose. 

The results possibly may have been altered in favor of the 
silhouette-devices if different familiar objects were used, especially 
in Pictures 10 and 12. The writer believes, however, that the 
familiar objects selected were reasonable. In fact, the experi- 
ment possibly was biased in favor of the silhouette devices, since 
the possibility of perspective confusing the reader was minimized. 
Furthermore, the result may have been altered in favor of the 
numerical terms if different captions were used. For example, 
the caption under Picture 6, “14 inches," may have been more 
effective if stated as “1 foot,2inches." In general, the numerical 
Captions and familiar items are representative of those which 
editors would select. 

„Тһе writer realizes the plausibility in the argument that а 
Picture suggesting relative size is acceptable at ‘face validity.’ 

П other terms, it may be sufficient for a pupil to realize an 
object stands in a certain relation to a man, regardless of his 
Concept of the latter. However, it is equally reasonable to 
argue that association of an object with its correct linear measure- 
ment is also sufficient. A realization of his association has two 
advantages. First, the pupils can communicate or otherwise 
Use the number with reference to the object. Secondly, the 
number may be translated into an exacting concept with the 
Use of a standard yardstick. 

No data were collected on the ability of pupils below Grade VI 
to use the alternatives. A concomitant study on the ability of 
Pupils in Grade IV to estimate a series of distances between one 
inch and seven feet was conducted. The results showed there 
Was little differences between the mean estimates of these dis- 
ances made by pupils in Grades IV and VI. There was, how- 
ias а significant difference in variability of estimates, with 
Pupils in Grade VI more closely grouped about the mean. 
While this suggests numerical terms may be less effective in 
Grade IV, a study in this grade on the ability of pupils to esti- 
Шабе the size of familiar items may also indicate more variability. 

е silhouette devices in Pictures 10 and 12 were intended to 


*Ibid., pp. 111-115, 
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provide suggestions for future studies. In both sets the pupils 
were asked to estimate the horizontal dimensions of the animals, 
although the familiar dimension of the known object was shown 
vertically. The results suggest this method of presentation 
is undesirable. A more elaborate study to test this tenable 
hypothesis is in order. 

Restrictions within the experiment prevented testing the 
formulated hypothesis in connection with objects of large mag- 
nitude. The writer believes that Dale is correct in contending 
that telling the size of a pyramid in terms of measurement is 
not likely to help the young reader. However, one must be 
cautious in assuming that a small familiar item, one most likely 
within the experiences of a reader, always suggests the actual 
sizes of a large object alongside it. Data collected in connection 
with Picture 12 suggests a familiar item may not be too effective 
when used to indicate the size of a much larger object. A study 
to determine the usefulness of small objects in indicating the 
size of large ones is necessary. In the meantime, the writer 
would suggest that both familiar items and captions be used to 
indicate the size of large objects. The advantage of the latter 


method, again, is that measurement can always be converte 
into meaningful concepts. 
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INTRODUCTION 


Prejudice verbalization (which hereafter will be referred to as 
PV for the sake of brevity) is defined as the production of 
Invidious comments concerning an individual, group, organiza- 
tion or concept. As an index of anti-minority attitudes, the 
presence or absence of such verbalization can by no means be 
i aen synonymous with the presence or absence of prejudice 
Bei . Among very young children, its presence may only repre- 
{ а verbal behavior pattern copied from parents, their sur- 
gates and childhood associates, rather than true emotionally 
ees attitude toward a minority. Among older children and 
adults, its absence can merely signify a reluctance to be identified 
as holding a socially reprehensible point of view. 
p fact still remains, however, that PV is often accepted as 
ауы. facie evidence of negative attitude. In the case of the 
Bemiti individual, particularly the child, anti-Negro or anti- 
m que expression at the. verbal level by others within the 
pre} tual’s social sphere will almost certainly be apperceived as 
ejudice рег se. For the child, it appears beyond question that 
ne к others is of importance in the etiology of any prejudices 
sum ay develop. Secondarily, it is also suggested that PV among 
in us children, learned at least in part from parents operating 
ad i permissive atmosphere of the family, may actually reflect 
“Cult attitudes more accurately than the responses of the parents 
те in direct interview. $ 
и toward the identification of personal, social and eco- 
Y c factors associated with PV among children that this study 
аз directed. Work by  Frenkel-Brunswik,? Meltzer? and 
421 


o 
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* indieate that children's attitudes are positively cor- 
ema qe of their adult associates. Previous ens 
by Holmes* indicating that southern college mea > Pm 
prejudice more frequently than do northern college stu j^ jo: 
leads to the expectation gi pee children will be 

o PV than northern children. . 

P indio and Sutherland’ reported a study of children's маза 
toward Negroes and Jews іп a small mid-western town w. ily. 
there were no Negroes and only one childless Jewish pes 
They found that statements of dislike for both minority gro 
increased with age. | 

` Adorno, et al,? working with adults, were able to find no a 
relation between income and attitudes toward minority ae 
However, they were able to discern a tendency for the offspri es 
of fathers in professional occupations, particularly ee 
and government occupations, to exhibit less eec Г 
anti-minority, attitudes than did those of fathers with О 


ic + nificant 
types of occupations. They found no statistically significa 
sex differences. 


Ackerman and Jahoda! 
climate’ as a determinant o 
Nazi Germany as represen 


suggest the importance of чаш 
f anti-minority attitudes, aene Ded 
ting a eultural climate which enco к 
aged anti-Semitism. In the United States, they say, the cultu : 
climate is not consistent, support for anti-minority feeling van 3 
ing from one eultura] Subgroup to another. They feel that pe 
minority behavior can be expected to show considerable wm 
eney on specific in-group pressures. Thus, while much e is 
has been made to explore the relationship between prejuc má 
and emotional disorder, it is Suggested that prejudice, eec 
larly at the verbal level, need not necessarily be associated Wi 


3 В E ior 
personality aberrations but, instead, may be conformity bebavi 
in a given cultural climate. 


THE PROBLEM 


The present study was designed to determine whether or s 
PV in children was Significantly related to differences in 8 p 
geographic location, father's Occupation, national origin, 8 
and school grade. 

POPULATIONS 


8 
Three sub-populations were Studied: seventy southern a 
seventy northern boys and seventy northern girls. The 


e 
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distribution (range: four to fifteen years), which because of 
matching is the same for each sub-population, is presented as 
Table I. None of the subjects concerned were Negro or Jewish. 


TABLE I.—DISTRIBUTION BY AGE FOR EACH SAMPLE 


Age N 
4 1 
5 6 
6 5 
7 10 
8 5 
9 8 
10 15 
11 7 
12 7 
13 3 
14 2 
15 1 
Total 70 
Taste II.—DISTRBUTION BY FATHER’S OCCUPATION ror EACH 
SAMPLE 
Occupation Southern Northern Northern 
A FS us Mon 
Professional 0 6 6 
Usiness 4 3 4 
Clerical and Sales 0 7 10 
illed 1 22 23 
Semi-skilled 2 19 20 
Unskilled 7 6 3 
Iscellaneous and Unknown 7 A 4 
cL жне Jee 
Total 70 70 70 


ed Southern Sample.—The seventy southern boys were 
Ville sia on a trip along U.S. Highway 301, between Fayette- 
n orth Carolina and Petersburg, Virginia, in June, 1950. 
d Were predominantly children of farmers. A breakdown for 
group by father's occupation is found in Table П. No 


& 
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data relative to school grade or national origin were obtained for 
this sample. 

The Northern Sample.—The seventy northern boys and seventy 
northern girls were interviewed in the five boroughs of New York 
City between June and September, 1950. The breakdown for 
this group by father's occupation is given in Table II. Distribu- 
"tions by school grade (range: pre-school to tenth-grade) are pre- 


TABLE IIL—DrsrRIBUTION BY SCHOOL Grape FOR NORTHERN 


SAMPLE 
Grade Boys Girls 
Pre-school 5 4 
Kindergarten 2 3 
First 6 7 
Second 9 9 
Third 7 6 
Fourth 6 19 
Fifth 14 6 
Sixth 12 7 
Seventh 4 1 
Eighth 3 4 
Ninth 2 3 
Tenth 0 1 
A> Ye... 2959 3004 
Total 70 70 


sented as Table TIT. 


t Ta A description of this sample in terms of 
national origin is give 


n as Table IV. 


PROCEDURES 

Collection of Data.—Pre 
through the use of sim 
approached and 


8 
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V ERN 
1E DISTRIBUTION BY NATIONAL ORIGIN FOR NorTHE 
E SAMPLE кР 
National Origin ые Females és 
“American” 
Armenian 
Chinese 
Czechoslovakian 
Danish 
English 
English-German 
English-Irish 
French 
French-Canadian 
French-Italian 
German 
Greek 
Greek-Italian 
Trish 
Trish-German 
Irish-Italian 
Italian 
Japanese 
Lithuanian 
Polish 
Polish-German 
Portuguese 
uerto Rican 
Russian 
Ussian-German 
Scottish-Italian 
panish 
Swedish-Irish 
Tainian 


m 
m 


m 
m 
[^ 


oor 
PRR NOOWrFOrFR ORF н 
© ы 
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verbalizations. In each case, at suitable points during the 
interview, the questions, 
Do you know what Jews are? What do you think of them? 
Do you know what Negroes are? What do you think of 
them? 
were asked, and the responses noted. In some cases, where the 
word ‘Negroes’ was not understood, the words ‘colored people’ 
were substituted. In all cases, the children were interviewed 
outside of the home and away from any institutional situation, 
but were instead contacted singly in the streets, parks, play- 
grounds, along the highway, etc. 

The presence or absence of anti-minority verbalization was 
determined by examining the interview protocol which was writ- 
ten immediately after each conversation. Protocols were not 
written during interview in order that freedom of expression ОП 
the part of children might be encouraged. 

Typical of the remarks judged to be PV were: 

“Tf any of them come to my block, I'll beat the hell out of 
them." 

“They have black faces and I don't like to play with them." 
""They got all the money .. . they're crooks . . . you 
can't trust them.” 

On the other hand, a comment similar to many frequently 


encountered, and which was judged to indicate absence of PV; 
was that made b 


created all of us . . 


one » - made us all alike. We must love every- 


as in a number of others, some of the 
ments pointed to an awareness of the 
: Other responses judged to be without P 
included: 


" They're all right.” 
"They're the same like 


During interview, when the interviewer was uncertain about 
Whether or not PV was actually present, (for example: “Т hey te 
OK, but I don’t play with them.”), further probing was mace 
until the attitudinal direction of the comments was clear. х 

Statistical Analysis.—In determining the statistical relationship’ 
of PV to discrete variables like geographic location, sex; father’s 
occupation and national origin, the technique for determining 
the significance of a difference between two percentages WAS 
employed. For example, when northern boys were compare 


anybody else.” 


© 


г 


+" 
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with southern boys on anti-Negro verbalization, the significance 
of the difference between percentage anti-Negro verbalization 
found in each of the two sub-populations was determined. In 
the case of the continuous variables, age and grade, the sig- 
nificance of a difference between the means of two samples was 
found. For example, in the northern sample, the mean age of 
children with anti-Jewish verbalization was compared with the 
Mean age of those without anti-Jewish verbalization, and the 
Significance of the difference between the two means was assessed. 
Ih the cases of both the discrete and continuous variables, 
Significance was estimated through the use of ¢ ratios which were 
calculated and interpreted from Smith’s Probability Table of 
t in terms of the acceptance or rejection of the null hypothesis. 


SUMMARY OF RESULTS 


Differences in prejudice verbalization by geographic location, 
Sex, father’s occupation and national origin are summarized as 
Table V which shows that: 

. 1) No statistically significant sex differences in PV were found 
11 comparing northern girls with northern boys, although in each 
category, anti-Jewish, anti-Negro and the combined anti- 
9wish—anti-Negro—or both, the boys showed a consistently 
higher percentage of PV. 

2) The southern boys exhibited significantly more of each type 
id PV than did the northern boys. Since northern boys con- 
Sistently showed more PV than northern girls, and, since there 
2 àn equal number of cases in each of the three sub-populations, 
AME for the northern girls versus the southern boys, which 

necessarily reflect significant differences, were not computed, 

et In the northern sample (boys and girls combined), children 

t Professional fathers showed significantly less PV of each type 
3n did the children of non-professional fathers. 

“) А group comprised of all children in the northern sample 
With English, Irish, German or Polish national origin was found 


a Pen significantly higher proportion of each type of PV than 


id all of the other children in that sample. 


Differences in PV for the northern sample by age and grade 
are presented as Table VI. 

5) While the mean age and grade of northern children with 
anti-Jewish verbalization were lower than those found for 
northern youngsters free of this kind of PV, the differences 


2 
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were not found to be statistically significant. ries d 
mean age and grade of children falling in the anti-Negro an 2 
combined anti-Jewish—anti-Negro—or both categories, we 


x 
TABLE V.—DIFFERENCES IN PREJUDICE VERBALIZATION BY б. 
(0) 
GEOGRAPHIC Location, FATHER’S Occupation AND NATI 
ORIGIN 


š i t 
bgi Anti- | £ | Anti- tio 
Type of Verbalization: Jowish |Ratio| Negro Rati 


By Sex and | Per cent of 70 Northern Girls 
Geographic 


Location Per cent of 70 Northern Boys 


57.14 |5 


5.69* 
7.684 — — 5.0 


Per cent of 70 Southern Boys 


Northern Per cent of 12 Children with 
Sample: By Professional Fathers 
Father's 
Occupation Per Cent of 118 Children with 
Non-professional 

Fathers 

SS ee ES 
Northern Per Cent of 68 Children with 


Sample: By English, German, Irish or 
National Polish National Origin 
Origin 3.33* 
— 
Per Cent of 72 Children with 

Other Types of National 

Origin 
———l 


* Significant at the one Рег cent level of confidence, 


1 3 f the 
t This represents the Percentage of southern boys who both knew the meaning d did 
word ‘Jew’ and exhibited anti-Jewish verbalization, Thirty-two Southern boys W! 


uded from the computation of this percentage. 


significantly lower than those of children who did not express 
these types of PV. 0 

In general (Table V), anti-Jewish verbalization tended ti- 
be more prevalent within the northern sample than was E 
Negro verbalization. In the Southern sample, both types aE 
PV were high and approximately equal percentage-wise. exe 
ever, in no case was any Sample significantly more алы-/е 
in PV than anti-Negro, t ratios concerned with this aspect bo as 
ing near zero. These ¢ ratios are not recorded elsewhere in 
report. 
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DISCUSSION 


In the statistical analysis it was found that of all possible 
dichotomies based on father’s occupation for the northern 
sample, the Professional—Non-professional dichotomy was the 
only one which yielded significant differencesin PV. This would 


TABLE VI—Dirrerences IN PREJUDICE VERBALIZATION BY 
AcE AND GRADE ron THE NomrHERN SAMPLE (N = 140) 


By Age in Years By School Grade 


Type of V. izati 
erbalization Мизан! i t | Mean с t 


Age | Age [Ratio| | Grade| Grade Ratio 


With Anti-Jewish Prejudice 


Verbalization 578.08 [2.15 dn 2606 
E [i] 1.69 |— "P 
Without Anti-Jewish Preju- 

dice Verbalization 83| 9.39 | 2.77 Ваа 2:86 
у Anti-Negro Prejudice 

erbalization 49) 7.88 | 2.18 en i T nes 

| Т А д 4.87* 
Without Anti-Negro Preju- 

ice Verbalization 91| 9.81 | 2.77 Rios 2-08 


With Anti-Jewish, Anti- 
токо бе Both, Prejudice 
erbalization 69| 8.17 | 2.24 e mde m 


Without Anti-Jewish, Anti- 
yore. Both, Prejudice 
erbalization 71) 9.79 | 2.67 D See 


* с : 
Significant at the one per cent level of confidence. 


d et to indicate that it is the educational or cultural level of 
ated ather, rather than his economic level per se, which is associ- 
maj With the child's verbalization of prejudice. In order to 
ааш simplicity in Table У, the statistically insignificant 

‘chotomies based on father’s occupations have been omitted. 

en children in this sample who did not know their father’s 
esc upations, or whose fathers were deceased, were excluded from 


8 portion of the analysis. 
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In dealing with national origin, it was felt that the limited 
samples available in terms of this variable did not warrant 
separate statistical treatment for each type of national origin. 
Instead, and in order to determine whether or not differences in 
cultural climate associated with national origin might profitably 
be more closely investigated in the future, children of English, 
German, Irish and Polish origin were compared as a group with 
those of all other types of national origin present in the northern 
sample. This breakdown was used because the majority of 
children of English, German, Irish and Polish origin showed PV 
within each of their respective national origin subgroups. 

Because of the extremely high incidence of PV in the southern 
sample, statistical differentiation in terms of variables like age 
and father’s occupation was found unfeasible and was not 
attempted. While both the northern and southern children were 
found to express prejudice at the pre-school level, the southern 
children verbalized prejudice equally at all age levels, while the 
northern children tended to exhibit less PV with increasing age- 
Thus, it appears that the results of this study are in keeping 
with the contention by Ackerman and Jahoda that cultural 
climate is a determinant of anti-minority attitudes. Their 
statement that cultural climate in the United States is not con- 
sistent seems to be borne out when the northern and southern 
samples are compared. In the northern sample, the cultural 
climate of New York City would seem to permit the emergence 
of such aspects as national origin, age and father’s occupation a8 
correlates of PY. „Оп the other hand, the southern sample 
exhibited PV so uniformly that it may be inferred that a broad 
southern sub-cultural tendency to PV was operating which 
obscured the effect of cultural and personal factors found to be 
associated with PV in the northern sample. 

It is interesting to note that the age and school grade differ- 
ences associated with anti-Jewish verbalization were not sig- 
nificant, while they were for anti-Negro verbalization. 
possible reason for this may rest in the difference in level 9 
abstraction required to identify the two minority groups. 
would seem plausible that younger white non-Jewish childre? 
can, on the basis of skin color, differentiate Negroes from them- 
selves rather easily. On the other hand, ability to recognize 
Jews as different from themselves rests on the formation of some- 
what more abstract concepts such as religious affiliation. 
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The findings of this study are in contradiction to those of 
Radke and Sutherland concerning their observation that state- 
ments of dislike for Negroes and Jews increased with age. A 
strict comparison of their results with those of the present study 
cannot be made because of a number of differences in sampling 
and techniques used in the two studies. . 

While it might have been expected that PV differences associ- 
ated with the sex variable would appear, in view of the difference 
in level of aggression between male and female to be found in the 
Social róles assigned to each sex, the findings of this study support 
à tendency in the direction of higher PV for males which only 
Approaches statistical significance. It is likely, however, 
that a larger sample would have yielded statistically significant 
differences. 

‚16 should be pointed out that, in assessing the relation of any 
Blven variable with PV in this study, no statistical technique was 
used for holding the effect of other variables constant. Thus, 
Tor example, the apparent significant relationship of national 
origin with PV may disappear when other variables associated 
With socio-economic status are held constant. In view of this, 
the results obtained should be cautiously interpreted and 
regarded primarily as suggesting promising areas for further 
research, 
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RELATIVE EFFECTIVENESS OF TWO TYPES OF 
RESPONSE TO ITEMS OF A SCALE ON 
ATTITUDES TOWARD EDUCATION 


CHARLES O. NEIDT 
University of Nebraska* 
and 
WILLIAM В. MERRILL 
Iowa State College 


One of the problems in constructing a scale for attitude 
measurement is the selection of the type of response for the items 
of the scale. Any one of several types of response may be used. 
For example, the subject may be asked to respond by indicating 
acceptance or rejection of a single statement, by indicating & 
position along a continuum of agreement or disagreement for ® 
single statement, or by selecting from two or more statements 
presented simultaneously that one which most closely corre- 
Sponds to his point of view. Р 

Веѓоге preparing an attitude scale in its final form, some evi" 
dence for evaluating various types of response to items is desir 
able. This evaluation can probably best be accomplished by 
comparing the results from several administrations of the scale, 
each involving a different type of response, with some external 
criterion representing the attitude which the scale purports 40 
measure. From a practical standpoint, however, the number of 
types of response under consideration will usually be confined to 
two or three. 

Tt was the purpose of the present investigation to determine 
the relative effectiveness of two types of item response to a scale 
on attitudes toward education. The over- or under-achievement 
of the college students used as subjects was employed as the 
external criterion for the evaluation. Over- or under-achiev™ 
ment was chosen as the external criterion since it was a form 0 
behavior entirely independent of the scale score, it could be 
objectively and accurately measured, and it could be assumed #0 


* The research upon which the results of this article are based was 8007 


ducted while the senior author was a member of the Psychology Depart- 


ment of the Iowa State College. 
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represent an expression of the type of behavior the scale, was 
designed to measure. 


METHOD OF PROCEDURE 


In an earlier phase of the research project herein described, 
Dodds! constructed two hundred seventy statements of attitudes 
pertaining to some aspect of education or attendance at college. 
From an item analysis following administration of these two 
hundred seventy items to three hundred eighty students, the 
ninety items which correlated highest with total score were 
Selected for use in the present study. 

The Forms of the Scale.—The ninety items finally selected were 
assembled into two forms of the scale. In one form a five-point 
Tesponse scale of the Likert? technique was used as a type of item 
response. In the other form of the scale, statements of similar 
Content, but expressing different points of view, were paired and 
the Subject was asked to select the statement most indicative of 
his attitude. For example: 


Td leave school if I... ___I intend to finish my college degree 
had а good job offer... even if I should get a good job offer. 


Since the same statements were used in each form of the scale, 
the Single statement form was composed of ninety items and 

€ paired statement form was composed of forty-five items. 

Administration and Subjects.—The two forms of the scale were 
administered to two hundred one second-quarter freshman 
Students attending the Iowa State College. One-half the sub- 
Jects took the single-statement form first and one-half took the 
Paired-statement form first. About forty-five minutes was 
required for administering the two forms. 

Tn addition to responding to the two forms of the scale, the 
Subjects were asked to indicate the number of hours they had 
Studied during the last two weeks. Administration of the scales 
ti accomplished at the end of the fourth week of the quarter. 

coring. —To construct a scoring key for each form of the scale 

© responses to the items of the twenty-five highest over- 
achievers and the twenty-five lowest under-achievers were 
tabulated, For the construction of the keys over- or under- 
achievement was defined as the difference between the mean 
vourse mark obtained by the student during the quarter in which 
€ took the test and the mean course mark which was predicted 
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for him using as independent variables his American Council оп 
Education Psychological Examination test score and his high- 
school grade-point average. Over-achievement was indicated 
by a positive difference (actually larger than expected) and under- 
achievement by a negative value. In identifying the extreme 
over- and under-achievers for the item analysis the regression 
equation was obtained by least squares for the two hundred one 
subjects and an individual prediction was made for each subject. 

The responses to the items in the single-statement form were 
weighted 4, 3, 2, 1, 0, or 0, 1, 2, 3, 4, according to the direction in 
which the majority of the over-achievers responded. The 
paired-statement form was scored 1, 0, or 0, 1, in the same man- 
ner. The total score on each scale form was obtained for each 
subject. 

In determining the relative effectiveness of the two types of 
response, the external eriterion was defined as the difference 
between a subject’s actual mean course mark received for the 
quarter in which he took the scale and the mean course mark 
predicted for him using his American Council on Education 
Psychological Examination score and the number of hours 
studied per week. Although used in constructing the scoring 
key, high-school grade-point average was dropped from the final 
АП alysis since it was felt that the same attitudes toward educa 
tion were reflected in the collegiate achievement of the subjects: 
Since the analysis of regression was used in analyzing the results, 


however, it was not neces: y to 
cessary to m 
ake individual pred 


RESULTS 


In Table 1 are shown the correlation coefficients from the final : 


analysis of the five-point Single-statement form of the attitudes 
scale. In Table 2 are shown the correlation coefficients from 
the final analysis of the paired-statement type of item response. 

The split-half reliability coefficients for the two forms of the 
scale were computed and found to be .67 for the single-statement 
form and .45 for the paired-statement form. It was also note 
by timing a group of subjects that 1.7 times as much administra- 
tion time was required for the single-statement form as for th? 
paired-statement form. 

The correlation between the two forms of the scale was found 
to be .668. 
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DISCUSSION 
i As can be seen from a comparison of the validity coefficients 
or the two forms of the scale, .355 for the single-statement and 
a for the paired-statement, differences in validity of the two 
ypes of response are negligible. From the standpoint of feasi- 


TABLE 1l.—ComnELATION COEFFICIENTS FOR THE SINGLE- 
STATEMENT FORM 
Attitude ACE Hrs. Hrs. 
Score Score Studied Studied 
(Xo) (Xə) r(Xs)* REJİ 


Course Marks (Y) .415 .477 .060 ‚112 
Attitude Score (Xo) ‚047 .115 .124 
АСЕ Score — (X») —.090 .107 


Rre = .496T Rytxoxsxy = .584] Texex:xs = .8551 


* 
DRE assuming a linear relationship for Хз 
omputed assuming a curvilinear relationship for Xs 


TABLE 2.—CORRELATION COEFFICIENTS FOR THE PAIRED- 
STATEMENT FORM 
Attitude ACE Hrs. Hrs. 
Score Score Studied Studied 
(X (X2) r(Xs)* — R(X2T 


сав Marks (Y) .459 477 .060 ‚112 
ое Score (X) 063 —.005 ‚024 
E Score — (X5) — .020 “107 


Ry 
rGux) = .496 Resixex) = -584 — Trxexix = 357 


* 
computed assuming a linear relationship for Хз 
omputed assuming a eurvilinear relationship for Xi; 


ea of administration the paired-statement form would seem 
T the more desirable under the circumstances here reported. 
in in relatively high correlation between the two forms (.668) 
‘the — with their reliabilities (.67 and .45) suggests that 
ae in this scale are heterogeneous with respect to the 
T Tt is conceivable that subscores for the scale could be 
more effectively than a single score. It may be that the 
n terogeneity of the items tended to favor the paired-state- 
ent form of response. 
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As was indicated in the discussion of the scoring key, the item 
responses of one-fourth the subjects involved in the final analysis 
constituted the basis for constructing the key. Although only 
fifty of the two hundred one subjects were involved, and although 
high-school grade-point average was not an independent variable 
in the final analysis, the key construction procedure undoubtedly 
resulted in some spuriousness of the final partial correlations. 
There is little reason to assume, however, that the key con- 
struction procedure affected one type of response more than the 
other. A further study is being planned to use the key here 
described in scoring the scales of another group of subjects for 
the purpose of checking ће validity of the scale itself. 


SUMMARY 


An attitudes toward education scale was administered in two 
forms to two hundred one college students. Single statements 
with a five-point response scale were used in one form and the 
same statements in paired arrangement were used in the other. 
Partial correlations between the students’ mean course marks an 
each form of the scale, with ACE scores and number of hours 
studied per week held constant were found to be .355 for the 
single-statement form and .357 for the paired-statement form. 
Reliab! ity coefficients were found to be .67 and .45 for the single- 
and paired-statement forms, respectively. 

Although the paired-statement form of response yielded a low 
reliability coefficient in this investigation, its effectiveness in 
terms of correlation with an external criterion suggests that it be 
subjected to further research and be given more consideration i? 
the construction of attitude scales, 
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BOOK REVIEWS 


Universiry or CurcAGo, FACULTY OF THE CoLLEGE. The 
Idea and Practice of General Education. An Account of 
the College of the University of Chicago. Chicago: University 
of Chicago Press, 1950, pp. 333. $3.50. 


s Colleges in the Nineteenth Century showed a high degree of 
similarity in their course offerings. Subjects were limited in 
number, and regardless of the student’s postgraduation goals he 
Was expected to follow the same course of study. The intro- 
duction of the elective system was the beginning of an accelerat- 
ing proliferation of courses and departments. While the elective 
System facilitated the training of specialists in many fields it 
limited the possibilities of a broad basic education which was 
claimed to be an advantage of the earlier classical liberal arts. 
By the end of the first quarter of the Twentieth Century there 
was concern over the trend toward specialization. Return to 
the classical program was impractical, so other ways of providing 
a broad education were sought. Literature of the past twenty- 
five years reports many experiments devoted to the development 
9f ‘general education’ programs. The function served by such 
Programs is the same as that of the classical liberal arts, but the 
content has been changed to conform more closely to the demands 
of our modern society. 

The College at the University of Chicago was one of the first 


‚ Institutions to design a general education program which was 


Consciously experimental. Introduced first in 1931, this program 

as had many changes in content and method; even today it is 
Not considered to be in its final form. In the volume being 
reviewed seventeen faculty members who have actively partici- 
Dated in the program describe its growth and its detailed pattern 
at the present time, The first chapter discusses the problem of 
general education as it has been considered in the College. | The 
Second chapter presents a history of the University of Chicago 
With special emphasis on the position of the undergraduate 
College. Part IT of the book includes chapters devoted to the 
Curriculum in the three main divisions, viz. humanities, social 
Sciences, and natural sciences, and in the auxiliary areas of 
mathematics, writing, languages, and integration. In Part III, 
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three chapters on methods discuss teaching, examining, and 
student advising. 

Admission to the College, on the basis of examination rather 
than completed high-school courses, normally takes place after 
two high-school years. In each of the first three years the stu- 
dent takes a special integrated course in the humanities, in social 
science, and in natural science. In addition English, mathe- 
matics, and a foreign language are included in the first to third 
years, respectively. The fourth year is devoted to history and а 
course designed to integrate the work of the first three years 
which is entitled * Observation, Interpretation, and Integration." 
Content as such is not considered the primary function of the 
three area courses; rather the objective is to develop judgment 
and methods of analysis and thinking. The В.А. degree is 
granted on the basis of successful completion of comprehensive 
examinations rather than on the basis of an accumulation © 
course credits, 

The enthusiasm and clarity with which the authors in the 
present volume report the work in their several areas shoul 
weaken the arguments of even extreme antagonists of general 
A The twenty-year experiment at the University 

16850 15 as important to the history of higher education in this 
country as was President Eliot/s introduction of the elective 
system at Harvard over half a century ago. Whether the com- 
plete program of the University of Chicago could be introduce 
in other universities might be questioned; that it affords a pla? 
by which other universities might be guided in adapting genera 
education to their special circumstances cannot be. 


UTTIT 
University of Illinois C. M. Lo 


Guratp R. PAscAL AND BARBARA J. Ѕоттыш, The Bender- 


Gestalt Test: Quantification and Validit Adults. New 
York: Grune and Stratton, 1951, bigi 


The Bender-Gestalt is one of the performance tasks often used 
by clinicians to evaluate mental functioning. The subject is 
required to copy a set of eight simple designs. Until the public 
tion of this manual, the test has been inadequately supplied wit 
scoring standards and norms, and validation has been ™U° 
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needed. Pascal and Suttell administered the tests to hundreds of 
cases and identified features most likely to occur in records of 
patients as contrasted with normals. These features are 
embodied in a careful set of scoring guides of a near-objective 
Sort. Unfortunately the report on item validity (Table 1) 
involves faulty statistical methods, but the total scoring method 
appears acceptable. Two scorers use it independently, on a 
o of very wide range, with a correlation between scorings 
of .90. 

For norms and validity studies, the investigators rely on hit- 
and-miss samples, testing whatever groups could be obtained. 
Granting that availability is a requisite, it is nonetheless unfor- 
tunate that so much effort should be expended on unplanned 
Samples in this and other clinical research. The authors present 
their findings with due caution and with commendable modesty ; 
they often admit to having no idea what certain findings mean 
Where less restrained clinicians would write several pages of 
rationalization. Yet they are not constricted: at one point (p. 
23) they squeeze a hypothesis out of data from three cases. 

The evidence for the Bender-Gestalt test is seemingly solid. 
Not only does it distinguish patients from community persons 
with bi-serial validities about .70; much more valuable in 
Practice, it discriminates substantially between patients who 
improve and those who do not, tested at admission. The 
authors discuss the qualitative indications that their experience 
Suggests consideration of, illustrate records of children, organics, 
and psychogenic cases with diagnostic discussion, and provide 
Samples for training scorers. There are one hundred four pages 
of text, apart from appendices, which will be of great assistance 
to those who use the test. Both the style and organization. of 
the material are rambling, but the authors’ ideas advance the 
usefulness of the Bender-Gestalt appreciably. 

Ler J. CRONBACH 


University of Illinois 


Bruno Вкттвинвім. Love Is not Enough. Glencoe, Illinois: 


The Free Press, 1950, pp. 386. 


Love eannot be given by parents who do not possess it. Parents 
Who do love their children do not have to be told to do so. It is 
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not enough to do the right thing at the right moment. Without 
the feelings and emotions that go with the act the effect is not 
educationally sound. For example, in bed-wetting, if the per- 
missive mother also kicks up a fuss about the labor of washing 
her sheets the child may suffer even greater guilt feelings than 
the one who is scolded for wetting himself. The foregoing 
statements illustrate the attitude which underlies both the 
selection and interpretation of materials in Bettelheim’s volume, 
Love is not Enough. The educational philosophy is that of John 
Dewey and the practice in line with the work of August Aichorn 
and Fritz Redl. A well told story of how Bettelheim and his 
staff have tried to apply these principles and practices in their 
work at the University of Chicago’s Sonia Shankman Orthogeni¢ 
School is what the book is about. It is the story of how an 
educational institution for emotionally disturbed children sets 
the stage and permits children who have been mishandled by 
parents to develop the courage to live and learn through living 
so that life is again made livable for them. Everyday activities 
are conceived of as carriers of personal relationships, experiences 
of mastering tasks previously avoided, and those in which the 
child in the past experienced defeat. | 

| The chapter captions reveal the nature of everyday experiences 
illustrated and considered. Illustrative chapter captions 870 
те s Ey “First Encounter,” “Events in Sequence) , 
20010. roams to Waking,” “The Challenge of Learning, 

Rest and Play,” and “The World Outside.” The book also 
contains sixteen illustrations by Myron Davis, the photographer, 
who lived with the children before doing his = and was in tha 
sense considered by the author a participant observer which is 
the manner in which he considers the staff. 

Although the education at the school is psychoanalytically 
slanted in its interpretation of behavior, Bettelheim is too realisti? 
an educator to apply orthodox Freudian techniques in dealing 
with the children, and instead of emphasizing the bringing #0 
light of unconscious he favors techniques for ego bolstering 0d 
the spot. Living spot therapy in a sense is what is practiced iD 
this school under his direction. Foy example, what they try t° 
do in a case of cleanliness is deal with anxieties around cleanliness 
in the settings in which they arose, that is, in the bathroom ат! 
the toilet. By the same token, oral disturbances can be dealt 
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with much more directly in the dining room than in the treat- 
ment room; and so on round the clock. The style of interview 
that is most frequently done by the staff members, called partici- 
pant observers, and the children is labelled by the author ‘mar- 
ginal interviews.’ This is interpretive in character but does not 
need to interfere with the momentary activity of the group or 
individual. The purpose may be to clear up an anxiety that 
interferes with the enjoyment or participation in an activity, or 
it may be to warn the child of an unavoidable outcome of his 
behavior that he does not seem to foresee. Again the author 
does not depend on symbolic thinking or its interpretation for 
the very good reason that “уе live with the children twenty- 
four hours a day. We do not have to rely on symbolic substitutes 
for events that took place in the past to be able to understand 
What may have happened at that time." 

Intended chiefly as a description of the way the author's school 
deals with emotionally disturbed children the volume will 
Specifically serve other specialists in the same filed, but it can 
also serve to advantage to enlighten individuals concerned with 
the specifies of child growth and education for growth. 

H. MELTZER 

Psychological Service Center 

St. Louis, Missouri 


Hanter Cantr, Editor, Aw» Mmprep Srrunx. Public 
Opinion, 1935-46. Princeton: Princeton University Press, 
1951, pp. lix + 1191. 


This book, the first volume of its kind, “aims to present as 
Many public opinion polls as possible in a convenient and useful 
form.” Tt includes reports from twenty-three organizations In 
Sixteen different countries, and, according to the jacket, it will be 
Indispensable to “historians, sociologists, political scientists, 
economists, editors, government officials, policy makers, and a 
host of others concerned with public reaction to current events. 

The problem of number of subjects, ‘size of sam 
with in the Introduction in general statements rather than by 
Stating the sizes of samples for each report in the body of the 
book. The variability is large. The U. S. polls seem to o 
pest commonly, 3,000 to a somewhat larger number; Fortune’s 


ples,’ is dealt 
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Executive Forecast, 10,000; the National Opinion Research 
Center, 2,500 to 3,500, but in some cases as many as 7,000; 
state election polls, 15,000 to 20,000 (in 1936, 30,000). Num- 
bers for foreign polls seem to run from 2,000 to 3,600 with a few 
exceptions where the samples are as small as 1,000. ‘The tele- 
graphic surveys use generally fewer than 1,000. The important 
matter is not how many ballots are sent out or how many inter- 
views are planned, but on how many returns are data actually 
made up. The present reviewer has made special inquiry оп 
this point which does not seem to be clear in the book. It 
appears that the numbers of subjects, size of samples, would 
not be less by more than 100 to 150, than the number indicated 
in the Introduction (pp. viii-ix). The minimum for any inclu- 
sion would be determined in terms of the particular country 
involved, its sampling methods and would be checked by expert 
authorities, 

The contents of the volume are not limited to what many 
people understand as opinion, but to a much wider concept, 
including answers to such questions as, “Did you have any 
burst pipes at home during the recent cold spell?,” ** Do you ever 
wear overshoes, rubbers, or rubber boots?," “Have you rea 

- 57 "Can you recall having seen . . . ,?" “What is your 
guess . . .?”” and questions eliciting likes and dislikes, preferences 
ete. Many, of course, fall under what is generally understood 28 
being matters of opinion: “Which of these plans do you favor 
i 2, Should America have the biggest navy in the world 2 

Do you think school teachers should be allowed to spank dis- 
obedient children at school?." Although vast in its compre 
hensiveness, the volume can hardly be thought to fulfill the 
advertising statement that it includes “every subject under the 
sun. 

The Table of Contents is an index (pp. xv + lix). In such a? 
immense work an index is more than usually difficult. Appa" 
ently they are always difficult since there are so few good ones: 
Despite all the work that has been done on this index, the reader 
will wish that more page references had been given instead of 59 
many statements, See so and so. One may be obliged to read 
forty out of eighty reports before he finds the study he desire? 
а page reference would have saved all of this work. In many 
cases it is obvious that the omission of page references is justi 
fiable, but omission on so lavish a scale is at least to be deplored. 


e 


zE 
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The immense sweep of subjects from A. A. A. (See Agricultural 
Adjustment Act) to Yugoslavia makes it impossible to comment 
in detail upon the contents of the volume. In certain studies 
it is possible to trace changes in opinion through a number of 
years, In many reports one can find differences in opinion in 
terms of age, sex, economie condition, and of known causes such 
as war, ete. Опе can look for a special subject which does not 
appear. Psychiatry does not appear in the index, but there is a 
strange and interesting heading, Mental Physiology, (at least 
not new, Carpenter’s book entitled Mental Physiology was pub- 
lished in 1874). Studies vary in number under a given title 
from one to nearly one hundred. 

Among the topics having the largest number of reported studies 
are included agriculture, air, military problems, Canada, children 
and schools, economie problems, education, elections, finance, 
food, Great Britain, industry, international coóperation, labor, 
liquor, national affairs, taxation, wages, war and United States. 
For many studies there are one or a few reports. 

There are no catchwords at the tops of pages but the indexing 
of the book as a whole makes it possible without undue loss of 
time to run down most but not all subjects. 

It is not the province of the reviewer (at least of this one), to 
raise the question as to accuracy and reliability of data reported 
in the volume. This has been done at great length and literature 
Оп the subject is easily available. It is very pertinent to raise 
| the question as to the influence of this book. It will probably 

be a sort of bible for large numbers of people for many years. 

Ow, especially, when daily papers and periodicals are con- 
stantly quoting results of polls, this volume might become one 
of the most powerful influences available. For those. who wish 
to vote with the majority, and for those who wish to agree with 
those who vote with the majority, here is a source which one may 
Use, or because of which one may be unduly influenced. А 

toe this connection it is to be noted that although the Copyright 

951 is printed conspicuously, just as plainly beneath the copy- 
“ght notice is the following: “The facts recorded in this volume 
may be freely used in other publications.” , С 

The volume is well and strongly bound and-should withstand 
Much continual reference to which it will undoubtedly be sub- 
lected, The type is clear and easily read. The presentation of 
Studies is such that results can be quickly understood. The 
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printing is in two columns. It is the authority in its field. It 
will be considered indispensable in a number of different fields. 


A. S. EDWARDS 
University of Georgia 


UP 


NORMAN Li: Munn. Handbook of Psychological Research on the 
Rat. Boston: Houghton Mifflin Co., 1950, pp. 598. $7.50. 


This work is put forward not as a text but as a complete review 
of the psychological research on the rat. Even so, it is difficult to 
-see how it can escape being used as a basic text in its field. The 
comprehensiveness of the book is indicated by the fact that & 
little more than a hundred pages are required for the bibliography: 

The problems, methodology, findings, and interpretations 
advanced in the book are those the research workers themselves 
have been concerned with. In all Munn seems to have been 
interested no more nor no less with systematic and theoretical 
problems than the men whose work is presented. А nice his- 
torical balance has been maintained. Morgan, Small, Wash- 
burn, Thorndike, Watson and Carr and other pioneer workers 
have their day as well as Lashley, Hull, and Tolman, their many 
Students, and others of the present-day. 

Undoubtedly psychological research on the rat has contributed 
as much to the development of psychology in general as that con- 
ducted im any other field. This book does not emphasize this 
contribution, It treats primarily the psychology of the rat. 
Hiis significant for what it tells us about the rat. It should be of 
inestimable value-to anyone interested from any standpoint, iD 
psychological research on the rat. 16 is doubtful if a work in 
experimental psychology superior to this, at least in terms O 
instructional value to the student, is to be found in any field of 
psychology. Of course it must be admitted that the author bas 
chosen a field that has lent itself to rigorous experimental inves- 
tigation more readily than most others in psychology. 

Substantial progress has been made in all aspects of the field 
since the appearance of Munn’s An Introduction to Animal, 
Psychology in 1933, which was actually a work on the psychology 
of the rat. Perbaps the most striking new developments are to 
be seen in abnormal and social behavior of the rat and research 
in systematic psychology. 

The ten chapters in the book bear the following titles: » 
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Introduction; 2) Unlearned Behavior; 3) General Activity; 4) 
Motives, Emotions, and Hoarding; 5) Sensory Processes; 6) 
The Róle of Sensory Processes in Maze Behavior; 7) The Learn- 
ing Process; 8) Some Aspects and Conditions of Learning; 9) 
Systematic Psychology; 10) Abnormal and Social Behavior. 

In reading this comprehensive exposition of sychdlogical 
research on the rat one is struck with the БМА. га the 
Psychology of the rat and the psychology of man. Naturally, 
the rat is of somewhat limited power. But as far as he goes he is · 
Strikingly similar to man. One would be rather hard put to 
find important psychological phenomena in the rat that are 
divergent from such phenomena found in man. Psychologists 
have been cautious about generalizing from animal data. Рег- 

арз our first concern should be to make sure we understand 
the animal, This is certainly the first concern of the animal 
Psychologist, J. B. Stroup 
State University of Iowa 


WERNER Worrr. Diagrams of the Unconscious, Handwriting 
and Personality in M. easurement, Experiment and. Analysis. 
New York: Grune and Stratton, 1948, pp. 423. 
Handwriting as an index of personality has typically received 
The Vorable and critical treatment in psychological literature. 
9 reason for this, according to the author of the volume 
"Um Teview, is that the experiments have been limited in 


. Scope and have merely proved the absence of arbitrary rela- 


Honships between single graphic signs and single personality 
А. This, he contends, does not disprove the possible rela- 
1008р between the total graphic expression and total person- 
‘ine Accordingly, in this comprehensive volume of handwrit- 
cand Personality, measurement, experiment, and analysis, the 
Дн well known for his experimental work in depth psy- 
e © ОБУ, attempts to evaluate and illustrate how handwriting 
eee subjected to experimental procedure in the light of a 

ore dynamic psychology. The method he advocates and 


poles is to select characteristic themes of personality and relate 


n to analysis of handwriting. A thematic akan ич 

aut E modern trends in projective techniquéc. It is 
a В Impression that direct analysis of expressive movements, 

Particularly handwriting, without intermediary materials for 
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projection allows more precise and more defined application of 
Scientific criteria than projective methods. The volume as а 
whole is impressive appearing and has the surface earmarks of a 
thoroughgoing and scholarly comprehensive work. Evaluative 
considerations, analysis of hypotheses, plentiful illustrations, 
lists of specimens of handwriting, attempted correlation with 
biographical material, graphs, drawings, tables, an extensive 
bibliography and index are all included. Does a more thorough- 
going analysis of the material selected, its organization and 
emphasis show up as well as its surface manifestations? 

The content of the book is presented in two large parts. Part 
I, entitled **Form and Movement,” includes a general treatment 
of the whole subject, containing the author’s thesis and argu- 
ment for a consideration of handwriting in personality measure- 
ment. In the seven chapters of Part I topics considered include 
symmetry, rhythm, configuration, consistency in personality, 
diagrams of personality, and the origin of configuration. Part 
П, called "Expression and Movement," includes chapters on 
unity of expressiveness, empathy and projection, symbolization, 
interpretation of graphic expression, the author's evaluation of 
the self, analysis of indicators of graphic expression, and a final 
chapter on handwriting and biography. The author contends 
that the findings he reports in this volume indicate that the 
unconscious movements in writing represent a reign of order, 
pel and configuration appearing in the same way as i 
bow ir реп consciously calculated, measured, and constructed. 
ў cal evidence for claims made are presented. The match- 
ing technique of which the author is one of the founders is applied 
here by him to show a more meaningful relationship and con- 
nection between handwriting and other forms of personality 
CADUSERION:. This is in line with his general feeling that graphic 
expression 18 not only patterned by some factors of personality 
but by the unity of personality, 

In spite of the author's attempts to show consistency of treat- 
ment of the various phases of the topic he considers, occasional 
inconsistencies and over-emphasis appear. In Part I, particu- 
larly, and to some measure through the book, he emphasizes ® 
need for dynamis and configurational approaches. However, 
in Table 16,4. lists the main characteristics of graphic expression 
indicative of a relationship between the appearance of writing 
and characteristics they signify without much reservation. 2 

n , 


^. 
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his chapter on biography he analyzes the hardwriting of Lincoln, 
Spinoza, Kant, and others with biographical materials. In 
Lincoln’s graphic expression, we are told inhibitory elements 
Seem to dominate. “Passivity, restriction, negativism, psycho- 
biological disturbances, dreaminess, introversion and sensitivity” 
are said to be manifested. But, we are also told that the opposite 
elements of activity and determination are also present in Lin- 
со, Тһе graphic expression indicates this potentiality although 
16 does not show that Lincoln made his own passivity an element 
9f activity and turned his melancholy into power. This final 
statement is an interpretation in line with biographical data, but 
у I$ not revealed in the analysis of handwriting. An analysis of 
Incoln's personality on the basis of handwriting only would 
% Ttainly be an incomplete one and, in terms of neglecting the 
Significant, a false one. Similar criticism can be made of other 
attempts at correlating biographical data with handwriting. 
hat this material represents real clinical validation is more 
Questionable than the author seems to imply or express. 
he author is a serious student, interested in experimental 
approaches to depth psychology and he is serious in this effort 
of his. What he claims for handwriting is worthy of considera- 
tion for further investigation, however, rather than for uncritical 
ee Ptance. The fact that some of the conclusions the author 
arrives at are best classified as based on subjective judgment 
rather than real clinical validation does not disprove the value 
of the Contribution. The least one can say is that the volume 
i have in it materials that are subject to interesting discus- 
an and Suggestive of experimental procedure for further investi- 
© tion of some of the problems raised, even though they do not 
seen a series of conclusions concerning handwriting in 
Personality measurement that represent validated insights for 
Personality understanding. H. MELTZER 


Sychologica] Service Center 
Louis, Missouri 


m 
us SToNr, Editor. Annual Review of Psychology. Hes I 
Stanford, California, Annual Review, Inc»1950, prow 
аа 1950 Annual Reviews, Inc., has added four elds to uA 
" mg: medicine, plant physiology, physical be we. de is 
Sychology. The oldest, Annual Review of Bio-Chemis. ч, 
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now in its eighteenth volume. Annual Review of Psychology is m 
its eleventh volume. і 

The chapters in Annual Review оў Psychology, eighteen in all, 
cover most of the major topics found in the Contents of the 
Psychological Abstracts. The Review will not compete with the 
Abstracts, but will supplement it in various significant ways. In 
the Review the authors have organized, synthesized and critically 
evaluated the research and theoretical writing of the year covered 
in their respective fields. (The period covered is roughly July 
1948-July 1949.) In many cases the authors have related the 
year’s development to recent previous work. This publication 
should aid psychologists greatly in maintaining contact with 
fields of psychology that lie outside their own specialization. It 
should be very popular with graduate students. 

The authors in this first volume have set a high standard. 
There are several outstanding chapters. Among these, those of 
Melton, Sears, Cronbach, and Thorndike should be of special 
interest to educational psychologists. 

Authors and Chapter titles are as follows: H. E. Jones and N. 
Bayley, Growth, Development and Decline; A. W. Melton, Learn- 
ing; №. R. Bartlett, Vision; E. В. Newman, Hearing; Е. А: 
Geldard, Somesthesis and the Chemical Senses; R. L. Thorndike, 
Individual Differences; R. R. Sears, Personality; J. S. Bruner, 
Social Psychology and Group Processes; C. L. Shartle, Industrial 
Psychology; D. O. Hebb, Animal and Physiological; N. À 
Cameron, Abnormalities; Н. Е. Hunt, Clinical Methods: Psy- 
chodiagnostics; W. U. Snyder, Clinical Methods: Psychotherapy; 
L. J. Cronbach, Educational Psychology; R. F. Berdie, Counsel- 
ing Methods: Diagnostics; E. S. Bordin, Counseling Methods: 
Therapy; D. A. Grant, Statistical Theory and Research Design: 
D. M. Johnson, Problem-Solving and Symbolic Processes. 


J. B. STROUD 
State University of Iowa 
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PATTERNS IN THE MASS COMMUNICATIONS 
TASTES OF THE YOUNG AUDIENCE* 


PAUL І. LYNESSt 
Development Division, The Curtis Publishing Company, Philadelphia 


This article summarizes a recent study of the mass communi- 
Cations habits and tastes of young people in school. The major 
£oal of the study was to discover what 'patterns of interest! in 
the content of the mass media as a whole characterized five 
different age groups of boys and girls. By ‘patterns of interest’ 
We mean here the tendency for certain subject matter to cluster 
In the content preferences of any given age-sex group, and the 
tendency for these preferences to carry over from medium to 
medium.: 

A M 

,* The study of which this article is a summary was the author's doctoral 
qe tation in mass communications, written under the direction of Pro- 
essor Leslie G. Moeller, Director of the School of Journalism, State Uni- 
Versity of Iowa, М 

T Formerly head of the Research Division, School of Journalism, State 

Diversity of Iowa, 

* Alice Sterner (Radio, Motion Picture and Reading Interests; A Study of 

d h-Selool Pupils, Contributions to Education, No. 932, Teachers comen 
CES ale University, 1947) has provided us with one Apr TS ee 
qu em of communication interest patterns. She strove to answe ha 

estions: “What really impels youth to spend so much time (in m 


Co a ek . S : jor ado- 
mmunications activities?) . . . Is it the medium itself or & major 


escent, inter i ;hich attracts the pupil?" 
e v love, which attr 
o; di st in adventure, humor or , lor lv all the 


Jer researchers who have studied interests in а] £ 
ps Simultaneously are: Wilbur Schramm, ‘Reading m. A qus 
саз of American University Students,” Journ. Quarter He ay m d 
Girls J. Scott, Reading, Film and Radio Tastes оў High-Sc A Fanci P. 
Robina ellington, New Zealand, 1947; Sidney L. Pressey ane otio 
nson, Psychology and the New Education, New York, 192°, in Lazarsfeld 


Tederi $ 
derick J, Meine, “Radio and Press among Young Poor Го. Paul A. 


and Stan 1 
A ton, Radio Research-1941, New York, 198% рр. ^99 dary- 
Witty and Anne Coomer, “Activities and Preferenéof ia, Ыр 
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It was felt that if rather detailed patterns of mass communica- 
tions interest could be established and described meaningfully, 
editors, station managers, and producers would find them useful 
in ‘beaming’ their output to specific audiences of young people. 
Such information would also enable teachers better to understand 
their pupils and to utilize the mass media more effectively in 
their teaching programs. Social researchers, too, preoccupied 
with the prediction and control of behavior, might find the 
material valuable in testing the interaction between youthful 
mass communications interests and personality, adjustment and 
behavior. 

With this as the problem, then, a rather comprehensive study 
was designed and carried out in the public schools of Des Moines, 
Iowa, in March, 1950.? 


METHOD 


Samples in five grades—third, fifth, seventh, ninth and 
eleventh—were selected by essentially random methods, although 
an initial stratification by sex and school attended was made. 
Students above the third grade filled out questionnaires in the 
classroom. Third-grade students were interviewed individually. 
The questionnaires were administered by teachers in the Des 
Moines public school system and graduate students at the State 
University of Iowa, all of whom were carefully briefed on the 
purposes of the survey and the procedures to be followed. The 
questions covered the amount and kind of reading, radio listen- 
ing and movie-going; the preferred types of mass communica- 
tions content (by medium); the names of preferred newspaper 
columnists, radio programs, movies, magazines, books and comic 
books; and preferred media. | 

A series of six pretests involving pupils in the third, fourth, 
fifth, seventh, eleventh and twelfth grades permitted a practical 
evaluation of the study design, the questionnaires and the 
methods employed. 


School Group," Journal of Educational Psychology, February, 1943, PP' 
65-76. 

2 The study was in large part financed by the Des Moines Register and 
Tribune Company. The writer wishes to thank Henry Kroeger, Director 
of Research and The /-wa Poll, Des Moines Register and Tribune, for his 
extensive personal „sistance in carrying out the project. 
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CHARACTERISTICS OF THE SAMPLES 


The total sample of 1,418 school children was made up of 
six hundred ninety-one boys and seven hundred twenty-seven 
girls. Over three hundred students in each of grades V, VII, 
IX and XI took part in the study. In addition, one hundred . 
fifteen third-grade students, fifty-nine boys and fifty-six girls, 
were interviewed. 

The breakdown of the total, by occupation of father, showed 
the following distribution: professional, eleven per cent; managers 
and proprietors, fifteen per cent; clerical and sales, twenty-two 
Per cent; service, six per cent; skilled labor, twenty-two per cent; 
Semi-skilled labor, eighteen per cent; unskilled labor, three per 
Cent; other, three per cent. 

By education of father, the percentage breakdown for fifth- 
grade students was: grade school, 5.6; high school, 26.6; college, 
35.6; don’t know, 32.2. For seventh-grade students, the break- 

own in percentage (following the same order as above) was 4.6, 
47.4, 26.1 and 21.9 respectively; and for the ninth- and eleventh- 
grade respondents, approximately 13.5, 44.3, 28.5, and 13.6. 
Information on the education of parents was not obtained from 
third-grade students. 

9 ther background data obtained in the survey included owner- 
Ship of automobiles, telephones, radios and TV sets; church 
affiliation and attendance; years of residence in Des Moines; 
Preferred presidential candidate in 1948; possession of a library 
card; and recreational activities at home and away from home. 


REPRESENTATIVES OF THE SAMPLES 

7 The samples were substantially representative of their respec- 
"Ve grade populations, in terms of sex and school attended, by 
Virtue of the initial stratification. Figures on parental education 
and occupation for all public school children were not available. 

owever, an estimate of 'representativeness' in terms of era 
ры was made as follows: A statistical comparison was oat 
o educational and occupational data gathered by The Iowa di 

n city adults with children in school and city adults withou 
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hem Towa Poll is a weekly, state-wide survey of TRAL DYT a ae 

mg topics of the day. It is sponsored by ле Des Мота пайы 
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children in school (state-wide surveys). The differences between 
these groups were insignificant at the five per cent level of 
confidence. 

Then, the educational and occupational data in the present 
survey were compared with three recent Jowa Polls of adults in 
the city of Des Moines. This test revealed no significant differ- 
ences in the occupational categories (at the five per cent level of 
confidence), except in ‘Managers and Proprietors,’ where the 
difference was significant at the two per cent level. The present 
samples contained more people from middle and lower status 
homes than The Iowa Poll samples. On the other hand, the 
test showed that the present samples were somewhat overloaded 


with children whose parents had attended high school and 
college. 


THE SURVEY CITY 


Des Moines, 2t the time of the survey, had a population of 
approximately 176,954 (1950 census). 'The morning Register 
and the evening T'ribune, both published by the Des Moines 
Register and. Tribune Company, were the city's daily newspapers. 

All four major networks had outlets in Des Moines, and, in 
addition, two independent. stations were located there. In“ 
1949, there were twenty-four moving picture theatres in the 
city. Des Moines citizens had access to over half a million 


library books in the ten public libraries, the Drake University 
library and the State Traveling Library. 


THE QUESTIONS RELATING ТО PREFERRED TYPES OF CONTENT 


In the questionnaire given to fifth- 


leventh-grad 7 , Seventh-, ninth- and 
eleventh-grade pupils, Seven questions dealt with preferred types 


tious communications media. Опе 
lowing: newspapers, radio, 
es, magazine stories an 


é gories accompanied each question. 
The pupils were asked to select and rank their four favorite 


types of content from each list, Thus, the question relating to 
motion pictures was phrased as follows: «1. Here are several 
different types of movies. Which four do you usually like best? 
Write ‘I’ before *&é type of movie you like best. Write ‘2’ 


“4 
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before your second choice. Write ‘3’ and ‘4’ before your third 
and fourth choices.” 

The check list of motion picture categories appeared below 
the question (See Table III). 

The radio and magazine check lists contained several names of 
programs and magazines exemplifying the categories. The 
illustrative programs had high Hooperatings in Des Moines at 
the time of the study and represented the various networks and 
Stations heard in Des Moines. For example, "Western shows 
like The Lone Ranger, Roy Rogers, Tom Mix, Hopalong Cassidy, 
etc.," and ‘Radio columnists like Jimmy Fidler, Louella Parsons, 
Walter Winchell, Sheila Graham, etc.” The magazines named 
were high circulation magazines in each classification. For 
example, “Sports magazines like Sports Afield, Outdoor Life, 
Sport, ete.,” and “ Girls’ magazines like Senior Prom, The Ameri- 
can Girl, etc.” 

In determining the preferences for each sex-grade group, the 
first, second, third and fourth choices for each medium were 
Weighted and combined. (First choices were weighted 4; second 
choices, 3; third choices, 2; and fourth choices, 1.) The weighted 


Бе : S. 
„Scores for each medium were then converted to percentage 


vie made easier the comparison of preferences in the different 
media, 


FINDINGS 


Tables I-VII contain the content ratings for each sex-grade 
Втоцр, and for all media, plus types of news. 

It should be borne in mind that these ratings are based upon 

e weighted first, second, third and fourth choices, and not 
Upon a single favorite in each medium. The four-choice s 
Was used in order to get some measure of intensity or depth o 
Interest, Ч 

A tabulation of first choices alone disclosed high grouP interest 
In a few categories. For example, the number one newsp in 
avorites of about three-fourths of all respondents In all a 2 
Were either comics or sports. With only a quarter of the if 
Choices remaining, to be distributed among fifteen to pr 
Categories, the ranking of the secondary interests became ede | 
What difficult and imprecise. On the other hand, the MA à 
of four Weighted choices revealed strong secondary interests 


i 
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TABLE I.—Favorire Parts ОЕ THE NEWSPAPER 
(In Per cents of Weighted Ist, 2nd, 3rd and 4th Choices) 


Boys Girls 
5th | 7th | 9th |11th 5th | 7th | 9th |11th 
2.2| 2.1) 1.4} 2.0) Advertisements .8| 1.9] 1.0] 1.2 
| „2 Book Reviews 1.0 .2| .5| -l 
-6| -7| .83| .3| Business pages | .4 2 
1.4. 1.1| 2.0) 2.9) Columns on publie af-| .9| .9| 2.1| 2.8 
fairs 
5] .2| .8| .9/ Columns on love &|3.1| 4.8 5.7) 4.8 
personal problems 
33.5/30.424.7/24.8| Comics 34.4134.7|26.8|22.9 
4.8) 3.21 1.0) 1.1] Continued stories 5.3] 4.0 1.1| -3 
1.4|.5.5| 2.0] 2.2| Editorials .6| 1.2| 1.0| 2.4 
1.2} 1.1| 1.4! 1.1! Gossip Col's 1.0| 2.0| 3.4| 3.0 
6.2) 6.7| 7.8| 5.8| Headlines 8.0| 5.9| 7.1| 6.0 
-2| 3| .5| .4|Letters to editor A] 7| 8| 1.5 
11.110.0 7.8| 4.3| Movies or radio news |12.2/13.2| 8.8| 5.8 
4.7| 9.5/12.6/15.0| News (general) 7.6| 6.0110.6/10.8 
8.6] 7.2| 7.8| 8.0| Pictures 12.1| 9.8 7.51 5.7 
А Society; Women’s fea- | 1.6] 3.0] 5.6/12.2 
tures 
22.7126 .4|28 . 1130 .5| Sports 9.8110.7|17.0]20.3 
7.2] 1.4 .7| Other 1.0 1.0] .1 
"i m None 1 
14561616|1547|1410| Weighted total 1557|1945|1458}1576 


See dog] et pL 


such newspaper categories as movie and radio news, women’s 
features, and general news, depending upon grade and sex. 
Comparisons of first choices with the combined four choices did 
show considerable correspondence in the direction and magni- 
tude of changes from grade to grade, 

One important qualification to the findings contained in 
Tables I-VII should Ке considered. The rating of each content 
category for each’sex-grade group is a relative rating; that is, it is 


взр — —À— €———————— 5 
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: boys and girls information on what thi 
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relative to all other categories for a given medium. Thus, the 
fact that interest in newspaper comics fell off somewhat with age, 
relative to other newspaper categories, does not mean that the 
older children's absolute interest in comics was less. It merely 


Tapie IIL—FavonrrE Types or RADIO PROGRAMS 
(In Per cents of Weighted 1st, 2nd, 3rd and 4th Choices) 


Boys Girls 
5th | 7th | 9th |11th 5th | 7th | 9th |11th 
14.211.2| 4.3] 1.7| Adventure serials 9.4| 6.5] 2.9] 1.1 
13.715.1/19.1]18.1| Comedy shows 13.5]15.4/16.7]13.3 

-1| .4| 1.1| 2.3| Classical music 1.2| 1.1| 2.1| 5.0 
9| .5| .1| .1|Love serials 3.6 1.8] 1.8| .8 
12.118.0/17.3/17.4| Mystery plays 12.0118.2116.7|11.7 
1.0) 2.8| 2.6] 3.4| News 1.3} .6| 2.0) 2.6 
8.5 4.0] 5.3] 3.8| Oldtime and west. 7.7| 5.8| 2.9] 2.6 
music 
6.0] 7.5] 9.6/110.0| Other plays (radio 12.0|18.7/20.3/21.5 
" drama) 
-5| 2.5| 6.8/15.8| Popular music 3.2| 7.8115.1/23.3 
8.4| 7.0| 8.3| 4.2] Quiz shows 12.3|10.4 7.9) 5.5 
-6| .7| 1.1| 1.5] Radio columnists .5| .0 1.4 1.8 
-4| .6| 1.1| 1.5| Religious programs 1.2| 1.9} 2.5| 2.1 
8.912.4113.7|15.5| Sports 2.7| 3.0| 4.1 6.5 
2| 1| .3| .2/ Talks; Forums n i 
24.8116.2! 9.0| 3.0| Western shows 19.2} 7.4| 3.1| 1.1 
3| .4| .3| .9|Other 9| a] $ 8 
sp. ct 9er ___ 1 
1573 16321574/1379| Weighted total - 1581119301470/1587 


means that the relative rank of comics among other newspaper 
categories was lower among the older boys and girls. 


Several questions in the study were designed to get from the 
ey actually read, heard on 


he responses to these ques- 
n the variety of reading, 
ёһ the eleventh grades. 


, newspaper content 


№ 
‹ 


u е radio and saw in the movies. T 
Hons indicated a sizeable increase i 
'stening and viewing from the third throw 

9" instance, analysis of 'vegularly read 
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showed an increased or stable proportion of responses, from grade 
to grade, in every category except ‘book reviews’ and ‘continued 
stories.’ Coming back to the example above, between 95 and 
100 per cent of the boys and girls in all grades said they read the 
comics regularly. 


TABLE III.—Favorite Types or Morrow PICTURES 
(In Per cents of Weighted 1st, 2nd, 3rd and 4th Choices) 
ИШК ошын S. eu ice qi aUi en eae aaa ш 


Boys Girls 
Hm. i o MENU 
5th | 7th | 9th |11th| 5th | 7th | 9th |11th 
11.1]14.8/18.4]19.6] Adventure 9.2| 9.6) 9.8) 9.4 
14.4] 8.0| 5.4| 3.7] Cartoons 16.8| 6.9| 3.0} 1.9 
14.715.513.515.2| Comedy features 14.513.812.7| 9.7 
2.1| 4.3] 4.1 6.2| Historical movies т .7| 3.0) 5.0 

-7| 4.9, 5.1 2.7| Horror movies 1.0| 3.7| 3.2 2.0 
1.3| 1.0) 2.2) 2.3| Love and romance 8.012.9112.814.8 
2.2| 1.7. 6.911.7| Musicals 11.718.1]22.228.4 
9.110.312.411.5| Mystery 9.510.3/13.5| 8.2 

.4| 1.0} 2.2} 1.2| Religious movies 1.9| 3.2] 4.9| 4.3 

-8| -3| .8| 1.5| Social problems 8| .7| 1.2) 3.5 
14.8[17.5[15.513.7| War 1.8| 2.6| 3.0 4.5 
28.218.1/12.2| 8.9| Westerns 18.6/11.8| 5.9| 2.5 

-7| 1.8) 1.2) 1.4 World of make believe | 4.4| 4.5| 3.0, 3-4 

.8| .1| .4| Other drama 1.1| 1.2) 1.2] 2.4 

a ыы ы. „г са |e 
1339|1567/1559|1340| Weighted total 1365|1877|1457|1519 


————— —— l ай le 


In radio program types listened to regularly, there was ап 
increased or stable proportion of responses, from grade to grade, 
in all categories, except quiz shows, westerns, adventure serials, 
old-time and western music, and love serials. 

Keeping in mind these reservations, one may make three 
general statements with respect to the data contained in Tables 


I-VII. 1) Both grade and sex influenced the degree of prefer- ' 


ence for certain types of content. 2) Preferences for certain 

types of content tended to remain at about the same level from 

age group to age group. 3) The tables disclose at least three 
ГА 


z 
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hypothetical ‘patterns of interest’ or generalized interests, which 
may be described as (a) violence and adventure; (b) love, private 
life, and glamor; and (c) ‘educational’ content (content which 
may be described as primarily informative and serious). 


Tastre IV.—FavonrrE Types oF MAGAZINES 


Boys Girls 
D O eae lcs 
Sth | 7th | 9th |11th sth | 7th | 9th |11th 
зата foun iua] fem 
3.7| 3.8] 4.6) 1.3] Adventure 01.0 .6 .1 
12.415.812.8| 6.2| Boys? Fu UE 
id 8.8| 6.1| 3.7| Detective story 1.0 5.8|8.0| .4 
30 2:7 2.4| 1.4 Farm 2.2) 3| 3| -5 
6 3.911.714.4| General appeal 4.4] 7.311.9]13.5 
5. 221 .4| | Girls’ 11 .416.015.7|15.1 
1.51 .9| .9| 1.8| Home service 6.2| 4.6 3.3 6.3 
4 .1| .1) Literary .1 б 
31 $9 5.6 9.0 Men's 8 4 | 7 
3-4) 3.6| 2.8| 1.6| Movie 12.616.4[14.3| 9.0 
es 1.4 1.3] 2.8 News TJ Бї 3 9 
e 7.8| 9.516.5| Picture 9 4| 7.9| 9.2|11.2 
ae 9.412.4/14.1| Science 1.9 .6| .5| -2 
:120.621.7923.3| Sports 6.8| 3.2, 3.0) 2.3 
x 1.3| 1.5| 1.2| Religious 1 21 1.8| 2.0| 1.2 
T 1.1) 1.2) 1.0] Romance 8.512.3/11.5| 7.2 
"O113.0. 4.8| 1.0 Western 13.5| 5.8| 2.3]. -3 
iE Women's 82 8.4 9.110.8 
—À 3; 2 Young women's 2 6.912.590 
Ие AA 
13121562/1560/1364| Weighted total 1354{1887|1441|1580 


І. TAIN 
INFLUENCE OF GRADE AND SEX ON PREFERENCES FOR CER 


TYPES OF CONTENT 


wie effects of grade and sex which were es 
be discussed under two major headings: ., —.; th the grade 
Categories which rose in relative popularity WI 


of the respondents: - 


pecially marked 


level 
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Both sexes.—The preference level of both boys and girls rose 
steadily, from the fifth through the eleventh grades, in the case of 
sports and general news in the newspaper; radio drama, popular 
music and sports on the radio; movie musicals and historical 
movies; general magazines; sports stories and features in maga- 
zines; and international and foreign news in types of news. 

Popular musie, radio drama, and movie musicals were con- 
sistently more popular with the girls than the boys. Newspaper 
sports and general news, radio and magazine sports, and inter- 
national news were consistently more popular with boys than 
girls. 

Boys.—The boys’ preference level, but not the girls’, increased 
with respect to the following: movie adventure; science and 
invention in magazines, books, and types of news; men’s maga- 
zines; picture magazines; adventure books and books on sports. 
All these categories were more popular with boys than girls, 
except for picture magazines and adventure books which were 
about equally popular with the sexes. 

Girls.—The girls’ preference level, but not the boys’, increased 
with respect to the following: women’s features and society, ап 
gossip columns in the newspaper; classical music on the radio; 
love and romance, religion, and war in the movies; love and 
romance, and women’s subjects in magazines; magazines for 
women and young women; historical fiction, and love and romance 
in books. All these categories, except war and historical fiction, 
were more popular with girls than boys. 

B) Categories which fell off in relative popularity as the 
grade level of the respondents rose: 

Both sexes—The preference level of both boys and girls 
dropped, from the fifth through the eleventh grades, in the case 
of comics, movie and radio news in the newspaper; westerns in 
radio, movies, magazines and books; adventure serials, old-time 
and western music, and quiz shows on the radio; movie cartoons; 
detective story magazines; and auto wrecks and Hollywood in 
types of news. Westerns and adventure serials were consistently 
more popular with boys than girls. Movie and radio news was 
consistently more popular with the girls, 

Boys.—The boys’ preference level, but not the girls’, fell off 
with respect to boys’ magazines and movie magazines; and crime 


O ac чү =н SD ME. | К ^ 
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TABLE V.—Favonire Types oF MAGAZINE STORIES AND 
FEATURES 


а Girls 
ИШНИ = a 
5th | 7th | 9th 11th sth | 7th | 9th |11th 
al ll daa ei Sel Fis = 
.2/13.3/13.0/17.2| Adventure 12.4| 9.4] 8.6] 6.1 
-2| 1.1| .5| 1.4] Art and music 6.1| 2.5| 2.3/1 3.0 
.4| .83| .2| .6| Business and industry Alia i 
1| 7.4) 7.8} 5.0) Cartoons 8.2| 8.6| 6.7| 5.4 
4| 8.1) 9.0| 6.7| Crime; Police; 4.9| 4.6| 4.7| 1.2 
gangsters 
4| 3.3] 4.5| 5.0| History and hist’l 1.2| 1.2| 2.1| 3.9 
fiction 

.6| 2.2] 1.2] 1.8] Hollywood and movies 8.9110.7111.3| 7.6 
4| .1| .1| .4| Home service PEERS! D: 
1111.8/12.5/10.0| Humor and comedy 13.915.916.617.8 
.3| .5| .2| Letters to editor 4) .0 1.6] .7 
-8) .9| 2.0] .9| Love and romance 6.613.5/13.9]18.8 
1| 9.8| 7.8 80| Mystery; detective | 8-2) 9-6 9.0| 4.4 
-1| 1.0) 1.5| 1.4| Public affairs ji A 
8| 1.2 1.6| .9 Religion and churches | 2.7 2.0| 2.9| 2.1 
-8| 4.3] 8.4] 9.2| Science and invention 1.3| 1.4 1.7 1.3 
-6| .5 1.3| .4| Social problems I) 2211225 
-5/16 .1/17 .8/22.9| Sports 3.7| 4.1| 5.6) 8.9 
2.1.7. 1.4) 2.4) Travel 10 .7| 1-2) 2-7 
`4(13.9| 7.0] 4.1 Westerns 14.7| 6.1] 2.3 ua 
1 d Women's subjects 1.6| 5.0] 7-9 б 
-4| 2.0| .4| .2| World of make believe 3.7| 2.4 1.5 Г; 
-6| .9| .7|Other FEES 

_| 9 soe | — 
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in types of news. Boys’ magazines and crime news were more 
popular with boys than girls. Movie magazines were more 
popular with girls than boys. 


TABLE VI.—FavonrrE Types or Books 
(In Per cents of Weighted 1st, 2nd, 3rd and 4th Choices) 


Boys Girls 
EE ee 
5th | 7th | 9th |11th 5th | 7th | 9th 11th 
12.8|15.119.2118.3| Adventure 14.616 .2|14.9]15.8 
2.7| 1.1| .6| 1.5] Art or music 8.5| 3.0, 2.13.2 

.8| .9| 2.2) 1.9! Biography 2.7] 1.4] 2.1] 3-9 
6.1| 4.1] 5.0] 5.5| History and histl 1.0] 2.0] 3.6] 9-2 
fiction 
-2| .4 .5| .1| Home service .6| 1.0] 1.7 1.4 
13.411.812.013.0 Humor and comedy — |14.820.4|21.0/20.6 
95.7. 1.5] 1.2 Love and romance 8.5/13.6/15.6/18.1 
9.810.2 8.8) 7.5 Mystery; detective — |10.113.713.1 5-9 
-2| .8| .8| .9|Publie affairs | „| «ы 

-9| 1.0] 2.2| Religious books 2.1| 2.6| 3.7| 3-2 

3.9] 5.6] 8.3. 7.1 Science and invention | 3.0, 2.7| 1.0, 1-6 
«9| "398.3 Social problems ly 2 .8 1.7 
183.116.819.2|22.0| Sports 7.1| 5.6| 8.5| 6-9 
.6| 1.8| 1.3| 1.9| Travel 1.9| 1.2 1.9| 1.9 
11.1]12.2| 8.011.4| War 13] 1.2} .9| 1-5 
22.1/14.7| 8.3] 5.0| Westerns 17.3| 8.1) 4.0) 2-0 
2.1 1.6) 1.3] .4 World of make believe | 6.1| 4.8) 2.0, 2-3 
.4| 1.6] 1.9] .8| Other 32.2 1.8| -8 
Mies low CI Malbec Rr. 
1319]1595|1561|1391] Weighted total 1429/1882 14891506 


————— H 4 ү | 1 


Girls.—The girls’ preference level, but not the boys’, fell off 
with respect to magazine adventure; the world of make believe in 
magazines and books; and sports magazines. Magazine adven- 
ture and sports magazines were more popular with boys than 
girls. The world of make believe was more popular with girls 
than boys. 
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Taste VII.—Favorite Types or NEWS 
(In Per cents of Weighted Ist, 2nd, 3rd and 4th Choices) 


Pun Girls 
E ux __ _ Ge 7| 
ша v8s | Gs Mi 5th | 7th | 9th [11th 
pv 13.6| 8.9| 6.9| Auto wrecks; accidents 9.3113.4| 9.2) 6.4 
-4| 1.9] 1.2| 1.6| Art, lit., and music 12.0| 5.4| 3.8| 5.9 
is .3| 1.11 1.0| Business and industry | .2 Ц -7 .6 
-9/17 .3/16 .3|13 .6| Crime; police; 10.811.1]12.0| 8.9 
8.1 gangsters 
9. 9.8. 8.6| 8.4| Des Moines news 13.0110.5|12.9|14.5 
i 7.9| 8.0| 9.1] Disasters 6.9, 9.7|10.6| 9.2 
-4| 7.3]10.4| 7.7| Internat’l and foreign | 3.9| 3.9 7.0| 7.5 
5| news 
15 .7| 2.2) 1.5| Labor Prob. S sS 25) 1.1 
| -2| .7| .1| Love and marriage 5.91 4.3] 3.4 4.2 
( problems 
A 2.0) 3.3] 4.2 Military affairs 39 .6 .8| 3 
11 5.8| 3.0| 2.5| Movies and Hollywood 16.819.014.5| 9.6 
11 -6| 2.5| 3.3| Politics and gov't S8 .9| 1.2] 2.7 
4.6 2.2, 1.0| 1.3| Religion and churches 9.8| 3.7| 5.1 3.0 
n 5.9| 8.0/10.2| Science and invention 3.1| 3.2. 1.8 8.7 
20.6 -7| 1.1| .3|Social problems 911.1 1.6| 2.9 
“31° -0/22.828.3 Sports 12.712.214.519.1 
Ла 8 Other 6 .3| .4 
1 __  |_ у _  . ———— кї 
п, 
CONTENT PREFERENCES WHICH TENDED TO REMAIN AT ABOUT 
GROUP 


THE SAME LEVEL FROM AGE GROUP TO AGP 


T А А to 
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8, апа 0. 


gr ; 
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ims Sexes.— The following categories drew high and lor 
o t ratings from boys and girls in all ing КО, tell 
CS an ore ior 
d sports (although the percentage 80 comedy in the 
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movies and on the radio; humor in magazines and books; mystery 
and detective in radio, movies and books. Sports and movie 
adventure were more popular with boys than girls. Humor in 
magazines and books was more popular with girls than boys. 

A consistent secondary interest was shown in horror movies} 
crime, cartoons, history and historical fiction and mystery in 
magazines; disaster, religion, and art-literature-music in types 
of news. 

Consistently low in the preferences of both sexes were adver- 
tisements, book reviews, public affairs, and gossip columns, 
in the newspaper; letters to the editor in newspapers and maga- 
zines; business and industry in all media ; news, religious pro- 
grams, talks and columnists on the radio; social problems in all 
media; serious drama in the movies; farm, literary, and news 
magazines; travel articles in magazines; labor problems, military 
affairs, and politics in types of news. 

Boys.—The following categories rated'consistently high with 
the boys in all grades: war in movies and books; adventure stories 
in magazines; and sports magazines. All were more popular with 
boys than girls. The boys showed a secondary interest in 
humorous books, adventure and movies magazines, and history 
in books. ў 

Low оп the boys preferred lists were columns on love and 
personal problems in the newspaper; love and romance in movies; 
books, and magazines; fantasy, and religion in the movies; 
magazines for girls, Women and young women; home service ап 
romance magazines; art and music in books and magazines; 
Hollywood in magazines; biography in books; and news of love 
and marriage problems. | 

Girls.—The following categories rated consistently high with 
the girls in all grades: romance, movie, and girls’ magazines; 
humorous books; magazine stories about the movies and Holly- 
wood; and crime news. All were more popular with girls than 
boys, except crime news. 

The girls showed a secondary interest in columns on love and 
personal problems in the newspaper; religion and fantasy in the 
movies; home service and picture magazines; books on sports; 
religion and art or music; biography; art and music in magazines; 
science and invention in books and types of news ; and love an 
marriage problems in types of news. Historical movies; adven- 


LA 
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is Science, boys', men's, and science magazines; and war 
ooks were low among the girls’ preferences at all grade levels. 


Ш. THREE HYPOTHETICAL PATTERNS OF INTEREST 


Tn order to get a more generalized picture of interest tendencies 
among young people, three hypothetical interest patterns were 
established, under which specific subject-matter categories 
could be classified. It was desired to uncover the extent to 
which these patterns characterized any given grade-sex group. 
еа three hypothetical patterns were (а) Adventure and 
font e (b) Love, Private Life and Glamor; and (c) "Educa- 
5 э content. All categories (in each medium) which were 
"5sumable under these headings were grouped together for 
analysis, 

Mean preference ratings for each pattern were calculated for 
ae grade-sex group by dividing the sum of the ratings for all 
p wh categories in each and every medium, by the total 
DEM er of occurrences of the categories in each and every 
ee a There were twenty-two total occurrences in the adven- 
of ] ana violence classification; thirteen occurrences in the case 
thi Ove, private life and glamor; and thirty-three occurrences » 
t e case of ‘educational’ content. These ratings were subjec 

О the characteristic disadvantage of means in that they could 
= skewed by extreme cases; however, there were few hx 
a. in the distributions concerned. Figure I shows grap E. 
im. the mean ratings of the three hypothetical patterns 

Crest by grade and sex. 

or е results indicated marked sex differences in à 

Adventure and violence, and love, private life and дог 
айу boys’ ratings exceeded the girls’ in every puis s 
ean nture category. The girls’ ratings exceeded fe vira ba 
ed love, private life and glamor category. E Н 

‘cated any substantial preference for ‘educational pu d ü 

Mir. were also clearcut differences by guns aL. ec 
:, boys Ute and violence, where the relative pre d 

ences p girls declined steadily as the grade adis 

Blamor e in the preference shown love, P 

en . ‘ 
It should pecie that most of the individual categories 


n the preferences 


life and 
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Ficure I. Comparison of Three Hypothetical Patterns of Interest, bY 
Preference Level, Sex and Grade. 


making up each pattern occurred in more than one medium; for 
example, mystery occurred in radio, movies, magazines 81 
books. Accordingly, the interests discussed in this section 
reflect subject-matter preferences in all media combined. 
Examination of individual categories revealed certain distinct 
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p related to sex and grade differences. Within the adven- 
with E violence pattern, interest in westerns dropped sharply 
Wieder atari age levels. Fifth-grade boys and girls gave 
код E afar higher rating than any other category ; yet eleventh- 
same t cin and girls gave westerns а relatively low rating. The 
Seria] encency could be observed in ratings of radio adventure 
мн The ratings for mystery, crime, disaster, war, and 
Bess € other than radio serials, remained at about the same 
cate E grade to grade. Also, interest ratings for these five 
Thess les were roughly of the same magnitude within grades. 
gave puo applied to both sexes, although in all cases boys 
Besos i er ratings to adventure and violence than girls. Both 
we ated horror lowest among all categories classifiable as 
venture and violence. 
E 2 müividual categories classified under love, r 
бё Were given relatively inconsequential ratings by boys. 
boys some interest in movies and Hollywood was shown by 
ratin, specially in the fifth and seventh grades. Girls gave high 
tendan, to love and romance, and movies and Hollywood.. 4 
жады их for the love and romance ratings to rise as the girls 
and H NS advanced was noted Conversely, interest in movies 
level ollywood appeared to drop progressively as the girls grade 
3 advanced. Considerably less female interest was shown in 
бшщ categories classified under love, private life and 
Probl т; that is, radio love serials, news on love and marriage 
radi “н, newspaper columns on love and personal problems, 
= columnists, and newspaper gossip columnists. 
е individual categories were classified under ‘educa- 
given oe With a few exceptions, these categories were 
i Ow ratings by both sexes. Relatively high ratings Were 


Blvi i + à ' m 
en science and international and foreign news by ninth- and 
eference 


private life and 


eleventh. ' à тт | 
ў -grade boys. History elicited a moderate pr 
rating fr th-grade 
i om d from eleventh-s 
boys, regardless of grade, an e ЫШ 


RD EUM and eleventh-grade girls also ranked i BESES 
cont Oreign news notably higher than other ‘educa A 
art {ры Fifth-grade girls showed а substantial рана de 
тең, iterature and music. These exceptions of course, We | 
ected in the mean ratings shown in Figure I, оа 0а 
ti * generally low ratings of all other categories under ‘edu 
onal’ content, 
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STRENGTH OF BACH PATTERN BY MEDIUM 


An indication was desired of the consistency of interest in the 
three hypothetical patterns from medium to medium. Accord- 
ingly, the preference ratings of all categories applying to each 
pattern within each medium were averaged. For example: In 
order to obtain the adventure and violence rating for radio, the 
preferences for the three pertinent radio categories were averaged; 
that is, adventure serials, mystery plays, and western shows. 
For movies, there were five pertinent categories—adventure, 
horror, mystery, war, and westerns. 

A considerable degree of consistency of interest from medium to 
medium was observed for certain grade-sex groups. Adventure 
and violence in all media appealed strongly to fifth- and seventh- 
grade boys. Love, private life and glamor in all media but 
radio appealed strongly to seventh- and ninth-grade girls. 
‘Educational’ content in all media, except magazines, received & 
low preference rating among boys of all ages. The somewhat 
higher male interest in ‘educational’ magazines, was due to the 
substantial popularity of science and mechanics. The girls’ 
ratings of ‘educational’ content were uniformly low in all media. 
On the other hand, marked media differences in the appeal of the 
hypothetical patterns to certain grado-sex groups were observed. 

_ Analysis of differences in the adventure and violence classifica- 
tion revealed that the older the student the less consistency from 
medium to medium. Adventure and violence in radio and 
magazines was much less popular among eleventh-grade boys 
than fifth-grade boys, although male interest in movie and book 
adventure and violence continued at a high level in all grades. 
Girls' preferences for this pattern followed the same general 
tendency; that is, for media differences to develop in the upper 
grades. Little interest on the part of either sex was shown in 
adventure magazines. This may have been due to the relative 
vagueness of the category. 

Girls' ratings of the love, private life and glamor categories 
revealed a tendency for magazine stories and features and movies 
to become more popular relative to the other media from the 
fifth through the eleventh grade. Conversely, the relative 
popularity, for girls, of magazines devoted entirely to love and 
glamor appeared to decrease sharply after reaching a peak in 
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the sev А 

el iens qus Radio categories in the love, private life 

fonde boul ea had no significant appeal for either sex at any 
Und ij ; 

в private life and glamor, radio and books were the 
ThHio-colu e 103 Тһе two radio categories were love serials and 
The Eme The book category was love and romance. 
ates e preference for "educational" content in magazines, 
mann other media, was due in large part to an interest in 

es on scientifie and mechanical subjects. 


THIRD GRADE PREFERENCES 


uesti m . 
бы! по used in the third-grade interviews 
were al type; no check lists were used. 
grades, yzed separately from those obtaine 

Third- 
mainly ges tastes, as revealed by this study, were focused 
make kan. the comics, westerns, animal themes, the world of 
By ins dd adventure, comedy and humor, and mystery. 
Comics in ih m, the prevailing choices of both boys and girls were 
fairy tal he newspaper; westerns on the radio and in the movies; 
comed. es and fantasy in books; adventure serials on the radio; 
iie d and humor in movies and magazines; animal themes in 
es and book i i ovies and 
magazines. oks, and mystery 1n radio fare, m. 
o Е А 
YS, more than girls, favored western movies and books; and 


myste 
and imis оп the radio. Girls, more than boys, favored comedy 
or in movies and books; and animal themes in books. 
‘or love, private life 


ce indicated little preference f f 
liking for n although a considerable number expressed their 
also sh ne movie and radio sections of the newspaper. They 
i ow little interest in informative, non-entertaining content 


In 
any medium. 


were largely of the 
Hence, the results 
d in the higher 


and 


AN ANALYSIS OF A PROCEDURE USED IN THE 
TEACHING AND RATING OF 
ORAL EXPRESSION 


FRANCIS J. DI VESTA and JAMES H. L. ROACH 


Air University 
Maxwell Air Force Base, Alabama 


The Air University’s Air Command and Staff School, like other 
schools of higher learning, has been faced with the problem of 
evaluating various types of seminar performance not easily 
measured by objective tests. Among these is the problem of 
rating students’ performance in oral presentation. Several 
methods have been tried for such ratings. New methods are 
being tried. The purpose of the present study is to evaluate the 
results of one general procedure used in teaching and rating 
oral expression at the Air Command and Staff School. This 
material is presented because the unique character of the course 


and rating system may be of benefit to those engaged in similar 
educational activity. 


DESCRIPTION OF THE COURSE 


The course in oral expression has been established to develop, 
in Air Force officers, the ability to organize speaking material 
and to present it logically and forcefully. This objective arises 
from the very practical needs of Air Force officers to speak before 
civilian organizations, to participate in Air Force conferences OF 
joint conferences with representatives of the other services and 
the departments and agencies of the Federal or State govern- 
ments, to brief their commanding officers, and to participate 
in staff meetings. Because the length of the course is only fifteen 
class hours, the instruction is oriented around formal oral pres- 
entation on the assumption that speaking before large groups 
would be the most difficult type of requirement to be met in the 
field. Only the elementary fundamentals of oral expression are 
taught. Students are not expected to be finished conference 
members or speakers at the end of the course, 
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The instruction includes three one-hour lectures on essential 
steps in preparing a speech, divisions and organization of a 
speech, and effective speaker projection. The remaining class 
periods are devoted to presentations by students. Each student 
is required to make four oral presentations. The first require- 
ment is a five-minute talk on some phase of preparing a speech. 
The second requirement is a ten-minute talk on a subject of the 
student’s choice, but of military significance. The third require- 
ment is a five-minute impromptu presentation on the student’s 
choice of one of four subjects within the broad areas of opera- 
tions, personnel, logistics, and world events. This is a test of 
the student’s ability to delimit a broad subject and to speak 
spontaneously on that subject. The fourth requirement is a 
prepared fifteen-minute talk wherein the student regards himself 
as a numbered Air Force staff officer required to give а speech on 
Some phase of the military establishment to a civilian audience. 

The total enrollment of four hundred sixty-five students is 
divided into small groups of about ten students each for the oral 
presentations. An instructor is assigned to each group. Both 
instructor and students rate each oral presentation on à rating 
Scale described later in this report. All students are required 
to make the first three presentations. Those students in the 
top twenty per cent of the class are exempted from making kk 
last presentation. Each rating provides a basis for grading the 


Student and for constructive criticism. 


DESCRIPTION OF THE RATING SCALE 


The rating scale, devised by the Evaluation Branch rp m 
University's Educational Advisory Staff, was made up od s us 
items rated on a scale of one to five. Items were E Бані 
basis of characteristics which, it was believed, could e & ү 
and remembered during the time the speaker was on - e D sat 
and which could be used as a guide for the speaker he js etd 
his speech. The number of items was limited to reduce age of 

ime as much as possible and still provide sufficient coveragi 


Qualities making for good performance. | tudent-raters were 

These considerations were necessary E during each class 
being used and a number of ratings Were mace 
Period. The rating scale follows: 


% 
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EVALUATION FORM FOR ORAL PRESENTATIONS 


I. Platform Presence.—Does speaker appear poised and purpose- 
ful? Ishe well groomed? 
1 2 3 4 5 
Ill-at-ease and untidy Slightly self-con- Poised and immacu- 
appearance detracts scious; presentable; late; excellent plat- 
from platform presence. acceptable platform form presence. 
presence, 


П. Introduction.—Is introduction effective in getting attention, 
and audience acceptance? Is objective understood? Did 
he establish importance of subject and lead smoothly into it? 

pl 2 3 4 5 


Inadequate introduc- 

tion; failed to accom- 
plish one or more of the 
purposes of an intro- 


Satisfactory introduc- 
tion, fairly complete; 
adequate but not ef- 
fective. 


Complete and very 
effective introduction. 


duction. 


ПІ. Actions—Do posture, body movements, and gestures 
increase effectiveness of presentation? 

1 2 3 4 5 
Unnatural, awkward Fairly natural ac- Natural actions 
actions; annoying man- tions; annoying man- greatly aid presenta- 
nerisms definitely dis- nerisms slightly dis- tion; no distracting 
tract from presenta- tracting. 
tion. | 


mannerisms. 


IV. Eye Contact.—Does speaker look at each member of the 
audience? 
1 2 3 Р " 
Eye contact detractive; Eye contact fairly ef- Eye contact very ef 
tended not to look at fective; tended to fective, well distrib- 
audience. look at audience ited, constantly 
looked at audience- 


V. Voice.—Is voice pleasing? Can you easily and clearly hear 
him? Is he fluent and forceful? 
1 2 3 4 5 
Voice boring, irritating; Voice pleasing, fairly Voice very pleasing 
indistinct, hesitant de- clear; matter of fact and clear; eloquent, 
livery. delivery. stimulating delivery- 


> 2, 
а а а а ———— AMI 
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VI. Phraseology.—Does he pronounce and use words correctly? 
Are sentences short, clear and complete? Does he use 
terms clear to audience? 


1 2 


3 4 


5 


Annoying grammatical 
errors. Poor choice of 
words. Does not de- 
fine terms; difficult to 
follow. 


VII. Body.—Is plan of presentation ¢ 


Minor grammatical 
errors. Satisfactory 
choice of words; 
meaning generally 
clear. 


major points effective and properly 
points and details? 


1 2 


Excellent grammar 
and sentence struc- 
ture; effective choice 
of words; easily 
understood. 


lear to audience? Are 


supported by minor 


3 4 5. 


Plan not clear, too 
many or too few points 
inadequately sup- 
ported. 


VIII. Transition.—Does speech move smoot 
from each part or point to following par 
it have continuity? 

1 2 


Disjointed transition; 


Parts not fitted to- 


ether: 
nm lacks contin- 


I 
X. Knowledge of Subject.—Did s 


Plan fairly clear; 
fairly adequate major 
points, moderately 
supported. 


Tair transition be- 
tween parts; {air cons 
tinuity. 


peaker have su 


Plan very clear; 
proper number of 
major points, well 
supported. 


hly and effectively 
t ог point? Does 


3 4 5 


Smooth transition; 
parts ht МАЦ te 
gether; excellent con- 
tinuity. 

ficient back- 


Bround of faets on subject? Did he understand ion. 
tions of material? Were his conclusions sound? pi т 
adequately cover and emphasize important aspects 


Subject? 
5 
ee аз _ 3 
1 thor- 

‘a Cked essential knowl- Fair knowledge of Bu xe sound 
hu of subject and its subject; conclusions oughly; CT Effec- 
i Dlieation; conclu- generally adequate; conclusio ad impor- 
Er. Íaulty; failed to partially covered im- on 
Det A important as- portant aspects. tant asp 

ech? Does 


X. Conclusion.—Does conclusion effectivel 
it have punch? Is it consistent with p 


y end spe 
urpose 
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1 2 3 4 5 
Weak, inadequate con- Fairly effective end- Concise, forceful end- 
clusion; new material ing, fairly consistent ing; drives home pur- 
introduced. Leaves with purpose; lacks pose. 


audience up in air, not punch. 
consistent with pur- 
pose. 


XI. Preparalion.—W as speech extemporaneous (not memorized), 
and was it delivered without excessive use of props such as 
manuscript, notes or lectern? Was it within time limits 
and was proper time apportioned to developing each point 
or part? Were visual aids effectively used? 

1 2 3 4 5 


Indieated inadequate 
preparation by exces- 
Sive use of props; poorly 
apportioned timing 
with speech too long or 
too short; faulty use of 
visual aids. 


Indicated fair prepa- 
ration by moderate 
use of props; fairly 
good timing; accept- 
able use of visual aids. 


Indicated thorough 
preparation by no re- 
liance on props; €X- 
cellent timing and ef- 
fective use of visual 
aids. 


XII. Interesi.—Did speaker establish and maintain audience 
interest in his subject and in himself as a speaker? Was 
audience reaction to speaker and subject friendly? 


1 2 


Dull and boring speak- 
er, no audience interest; 
audience reaction indif- 
ferent or unfriendly. 


3 4 


Moderate audience 
interest; audience re- 
action fairly cordial. 


5 "n 
Intense audience 10- 
terest; audience reac- 
tion very friendly. 


The grade for any one oral presentation was composed of the 
average of all students’ ratings on this form added to the instruc- 
tor's rating. Ratings are corrected for tater Yew By Hi ply 
adding or subtracting the rater's deviation fcm tive most ДГ 


ratings. Instructor ratings and students’ ratings are correcte. 
independently. 


An indication of the reliability of ratings made on this scale 
was determined by finding the correlation between the average 
of student ratings and instructor ratings on each student's 
presentation in the second oral requirement (a ten-minute "m 
pared speech on a subject of military significance). The сог 
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сона four hundred sixty-five scores paired in this 
is Marcela 5 а Although this correlation is not as high as 
Se е 2 к reliability coefficients, it does represent a 
се ^ ionship of better than moderate magnitude. 
ice nformation about the rating scale is presented in 
ТҮП. S adi intercorrelations of ratings on each characteristic 
нм аа Ls every other characteristic and the total score 
ih з. ‘he item numbers in this table correspond to the 
s in the rating scale. 


вем Scores ON EACH OF 


Tas 
LE L—INTERCORRELATIONS BETW 
nM FOR ORAL 


THE Тұт 
TwzLvE Facrors or tHe EVALUATION Fo 
PRESENTATION AND THE Тотали SCORE* 


(N = 465) 
It 5 
d Rating Scale Item Number* 
bert |r| п Total 
eli vivilvivn|IX| X |X XII 
I » у (PE a Se ee aime 
ol ик al asl .42| .в1 | 44] 44] 35] 58] -73 
III 137.35 .44| .42 | .42 | -40| .29 .48| .62 
IV `42| 36] 30] -38 | -41| -31| -26 .42| .02 
у `38| 34] .11| .41 | .35|.31 .96|.44| -61 
VI “47| 36| .42 | -38| -38| -33 .46| .65 
ҮП .42| .51 |.47 1.45 ‚37|.46| .68 
уп `68 | os| .50 | 50 | -63 78 
Ix “68 | .50| .54] -58 ‚79 
X 
XI 
XII 
Presentation III only. 


* 
Data 5 
a is from the instructor ratings on Oral 
a numbers correspond to numbers opposi 
In the text. 


te the rating scale items 


show 


b P А be 
eim intercorrelations indicate the existence of & Vaga 
e р among all items. Relatively i р 
OY ec each item score and the total i 
ships are desirable because they 
ea Н < ч 
эзш evidently makes some unique contribut r D de 
- None i so highly wit 9 
of the items correlates s ҮП, VIII, 


Scor, E 
е that it could replace the entire scale. Item. 
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IX, and XII have relatively higher intercorrelations ра 
items. This із to be expected, since they are also related in и 
practical situation. Each of these four factors is wap В 
preparation of the subject-matter content of the speech. . pi с 
results have not been factorized, however, to determine re 
extent to which the assumed factors or other factors actually 
are present. " 
RESULTS 


The effects of the oral presentation program are illustrated in 
the data obtained from the rating scales. 

Table II shows the mean scores and standard deviation for 
each of the oral presentations. The scores shown are 2 com- 
posite of the average of nine student ratings plus one instructor 
rating. The total possible score is thereby 120. From this 
table it will be recognized that the rating scale reflected ап 
increase in scores as the course progressed. Differences in mean 


Scores between any one speech and each of the other speeches 
are significant at the one per cent level. 


L 
TABLE IL—MzaANs AND STANDARD DEVIATIONS or THE ORA 
PRESENTATION SconEs* 


Speech 
Number Number Mean SD 
I 460 85.8 10.75 
п 460 90.9 9.45 
ш 460 89.1 9.82 
IV 360 92.5 8.16 


* Differences between means on Ora 


1 Presentations I and II, I and IV, 
II and III, and III and IV are significa 


nt. 


The lower mean score for Speech III may be interpreted as 
evidence of the validity of the scale. Speech III is the five- 
minute impromptu speech with only ten-minute preparation. 
On this basis it would be expected that the individual's work 
would be poorer than on a prepared presentation. This died 
pretation is reflected in the lower mean score for the third speec 
than for the second or fourth speech. ч 

Intercorrelations between each speech апа every other speet 
are shown in Table III. These correlations show a substantia 
relationship between student performance early in the course an 
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later performance. Lower correlations between scores on 
Speech IV and scores on other speeches are undoubtedly a result 
of the increased homogeneity of the class (the top twenty per 
cent on three earlier speeches were excused from making the 
fourth speech). 

TABLE III.—INTERCORRELATIONS BETWEEN EACH OF THE ORAL 


PRESENTATIONS AND FINAL ORAL PRESENTATION Scores 
Crass 49-B, AC&SS 


Oral Presentation . 
Final 
Oral a CONG = =Т= 


Presentation I II 


I .67 


Final Score 


ss of those individuals in the 
= 46) and those in the lowest 
ected on the first ише 


Чоп, The averages for these groups are shown in Table i 
he significance of the differences between the scores for eae 
Speech for each of these groups is shown in Table V. kx 

Although there is a drop of five points from average of ics ів 
to Speech III for the highest ten per cent, = CR 
Significant at slightly more than the five per cent 1698.0 


» A study was made of the progre 
"iind ten per cent of the class (N 
еп per cent of the class (N = 46) sel 


(TATION 
Tate IV.—Mrans or Scores ғов Each Orak Ds STUDENTS 
ADE BY THE HiGnrsT AND Lowest 10 PER Cunt OF 


on ORAL PRESENTATION No. 
Lowest 10% 


Highest 10% I 
Speech on Speech I E 25 ae’ 
I 105.2 79.2 
ш 99.9 86.7 


aA 
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fidence. None of the other differences in speech scores for this 
group is significant. 

The lowest ten per cent of the class on Oral Presentation I 
made gains significant at least at the two per cent level of con- 
fidence except for the progress shown from Oral Presentation II 
to III. Again, this is probably accounted for by the fact that 
Oral Presentation III was an impromptu requirement. 


TABLE V.—SIGNIFICANCE OF DIFFERENCES BETWEEN ORAL 
PRESENTATION AVERAGES MADE ny THE HIGHEST AND 
Lowzsr 10 Per CENT OF THE STUDENTS SELECTED 
ON THE BASIS OF ӨРЕЕСН I SCORES 
(N = 46 for each group) 


Differences Highest 10% Lowest 10% 
Between Speeches: рр | x: ? - " 
а 
land 2 13.21 | <.01 
l and 3 19.20 | < .001 
land 4 32.76 | <.001 
2 and 3 1.66 | <.50 
2 and 4 14.98 | <.001 
3 and 4 9.03 | 2.02 


RELATIONSHIP BETWEEN PERFORMANCE IN ORAL EXPRESSION AND 
OTHER FACTORS 


Correlations were found between the final oral expression 
grades and several other factors on which scores were available 
(see Table VI). The data studied were as follows: General 
Survey Test—a two-part test yielding a score on student achieve 
ment in Air Force background subject matter, another score for 
achievement in mathematics, science, and English and a tot 
score; the American Council on Education Psychological Examina- 
tion’s Q, L, and total score; the student officer’s rank; the student 
officer’s period of active service; the student officer's age; con- 
solidated scores of fifteen class examinations; and grades on the 
final school problem, which is a simulated problem situation 
solved by a staff of sixteen student officers, 
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TABLE 
VI.—ConnzLATION or FINAL ORAL EXPRESSION GRADES 
AND TWELVE FACTORS 


(N = 465) 
Correlation with Oral 
G Factor Expression Grades 
eneral Survey Test 
Military subjects 31 
Basic .96 
Total .33 


ACE Psychological Examination 


9 score (quantitative) 22 
Score (language) 
Total 74 
Rank 00 
Montt i 
ye hs active service a 
ge 
Class examinati А 
examinations (15 consolidated 
. Scores) x 
Final ве 
те school problem (staff problem) “ae 
class standing (including oral 
.50 


expression) 


with The oral expression grades have a hi 
е intelligence, as measured by the 
ас Trece di (т = .30), staff action. (r eas 
Noted Ъ ent scores (r = .31). А still highe 
Writte etween oral expression and classroom ach 
e n examinations (r = .47). 1618 interesting oe 
oral expression grades correlate more highly with the Am 


can Co x 5 ‚178 L score 
uncil o К Examination s 
be. n Education Psychological The difference 


30) than wi = 

b an with the Q score (r= 42) ant 

С а these correlations is, via Fisher’s Z transformation, 
cant at the one per cent level of confidence. 


ievement oD 
to note that 


Fe SUMMARY А plished 

for oral expression course at the Air Unido кк 

and © purpose of imparting basic principles in the Е грыве 
delivery of speeches. Practice is given t rough fou 


478 The Journal of Educational Psychology 


requirements. Appraisal of student performance for purposes 
of evaluation and guidance is made by student and instructor 
ratings of each speech. 

Results of the analysis of scores on the evaluation form for oral 
presentation indicate that (1) raters are differentiating between 
presentations; (2) growth and development in oral presentation 
takes place throughout the course; (3) no progress in oral pres- 
entation was reflected in the evaluation scale for those already 
qualified at this level of oral expression; (4) those who were 
originally very poorly qualified in oral expression developed to а 
point where their average score on the final speech requirement 
exceeded the entire class average on the first oral presentation. 
One might conclude that, as a group, the Air University students 
improve in oral expression throughout the period of instruction 
and, furthermore, that most improvement is d by those 


individuals who were poorest in oral expression befor attendance 
at the Air University. 


. Specifically and forcefully to that part of the gun. 


— жж | 
di ш ой ——— 
э эы —— а ——— M— е 
ч Мыр Se рН 
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THE EFFECT OF ATTENTION-GAINING DEVICES 
ON FILM-MEDIATED LEARNING* 


D. MORGAN NEU 
The Pennsylvania State College 


INTRODUCTION 


d iens c have employed a wide variety of techniques to 
pro dn e emphasis and increase the teaching effectiveness of their 
s атин In general, the devices employed to direct attention 
int з particular points of the content presented may be divided 

0 two broad classes: ‘relevant devices’ and Grrelevant devices.’ 
Dr Wo devices’ include any emphasis technique that is 

ated to, or operates upon, the specific point to be emphasized. 


Я exi H H 
or example, an ultra-close-up of part of а gun’ brings attention 
‘Irrelevant 


devi $ | 
€vices’ include any emphasis techniques that call attention to 
to the film content. For 


um en but are otherwise unrelated to ( P 
of pa e, interrupting a film on а technical subject with а 5 
Ww athing beauty is an instance of an ‘irrelevant device. 
Dort e current learning theories and the experiments that E 
of th hem are not entirely in accord on the relative effectiven 
ese two methods of ensuring the perception and learning © 
e salient points in a lesson, the consensus seems to be that, in 
* long run, ‘relevant devices’ should facilitate recall, while 
relevant devices’ should act as distractors and inhibit recall. 


18 inference is obviously at variance with the results hoped for 
n to the 


Sr 


S aarp who insert sequences that attract anton M 
me. i i int of information. 
ut relating to a specific po oe tee О 


im 

cur ан, therefore, to determine experimentally t 
hing of such different attention gaining techniques. 

OTHESES 


STATEMENT OF THE PROBLEM AND HIP | 
e the relative 


T А : 
Pas major purpose of this study was to determin viens 
lveness of three levels of attention-gainiDg а 
E uiremen 
for Summary of a dissertation completed in pursuance of CN ree 
desc e Ph.D. degree at The Pennsylvania State College; 1 Film Research 
To; Tibed here was accomplished under the Instructio" ith the Specie 
Devices, under Contract N6 onr-269, Task order VH, 
5 Center, Office of Naval Research. 
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relevant devices, (2) no devices at all, (3) irrelevant devices. 
Since it is possible to insert devices in the sound track or the 
visuals, the róle of the medium of presentation has also been 
studied. In order to maintain a clear cut comparison between 
the sound and visual media, sound and visual attention devices 
were each studied separately. Three hypotheses were formu- 
lated for testing as follows: | 

1) Device relevancy.—' The hypothesis is that film-mediated 
learning will be facilitated by the use of relevant attention- 
gaining filmic devices, and inhibited by irrelevant attention- 
gaining devices. The hypothesis was tested by comparing 
versions of a film containing, respectively, relevant devices, nO 
devices, and irrelevant devices. . 

2) Device mediwm.—' The hypothesis is that film-mediated 
informational learning will be equally facilitated by visual an 
Sound devices of the same relevance. The hypothesis wae 
tested by comparing learning from visual device versions with 
learning from sound device versions. This comparison is made 
separately for relevant and irrelevant devices. А 

8) Device recall.—The hypothesis is that recall of the devices 
themselves is relatively independent: of learning of the factual 
information content of the film. 


EXPERIMENTAL DESIGN AND PROCEDURES 


The Experimental Films.—To accomplish the comparisons 
required by the hypothesis, five versions of a film presenting an 
introduction to machine Shop measuring instruments were pro- 
duced. The five versions included the following: ; 

1) Basic (identified as В in the tables): contains no experi 
mental emphasis devices, but gives a clear, straightforwar 
treatment of the subject, ; 

2) Visual relevant (VR): contains attention-gaining device? 
in the visuals that are related to the points of content being 
emphasized. Я 

3) Visual irrelevant (VI): contains attention-gaining devices 
in the visuals that are unrelated to the points of content beng , 
emphasized. mE 

4) Sound relevant (SR): contains attention-gaining devices 19 
the sound track that are related to the points being emphasized. 


E E 
есі of Atlention-gaining Devices 481 


5) Sound i 
the sound tr. trelevant (SI): contains тонер 
; Choice, озш: are unrelated to Lipsiae E m 
Actory comparabi сш placement of the devices.—T jen à 
i f judges selected н ity among the four ‘device? Mei it мна 
D intensity and s sets of devices considered to be es 
E It was dust V bable effectiveness in gaining hes 
UM tò the T " the devices selected should not add inf 
attention-gaining ot ut should be used solely for their possible 
x ention-gaining Ps rd Furthermore, it was decided to ET i 
oF stimulus bes aa that would represent various n 
„е e Marina deniers and change, size, intensity, 

^ me à dicia сш novelty and peculiarity, impres- 
i vas i A 
Portant the ole poe at each of the same twenty-six most 
E EN кене in how version. Table 1 lists the devices and 
m Thus, a point ation to the informational content of the 

е device (e.g emphasized in one version by à visual 
E pesi bos. br E кеке is also emphasized in the other 

vices exa a e It will be noted that 


THE TESTS 


Two test 
of ; sw 
P ‘informa ie grim to provide measures of (1) learning 
S prised one h (2) recall of devices. The information test 
enty-five ee ыр four multiple-choice items, of whic 
» S test had e | picture-choices rather than verbal choices. 
о» 20). a high reliability (94 by Kuder-Richardson 
х evi 
Which fione recall test included sev 
Subjects w. y identified a device by 
e film Q called upon to check whet 
Temembe ) the item was not in the film, oF 
г whether it was in or not. 


enty-seven items, 
a short statement. 
her (1) the item was 1n 
3) they did not 


THE POPULATIONS 
rate military 


New Jersey, 
al Training 


two Sepg 
ort Dix, 
Nav: 


The 
experi 
Populations: (1) 1 was conducted with 
Be 1055 NS (1) 1576 Army recruits at F 
ation, С vy recruits at The Great Lakes 
» Great Lakes, Illinois. 


Basic Version 


TABLE l.—DrscRIPTION OF ATTENTION-GAINING DEVICES 


\ 
Attention-gaining Devices Added to Basic Version 


Visual Relevant 


Visual Irrelevant 


Sound Relevant 


Sound Irrelevant 


. Three metal blocks, rectan- | White line appears on | Concentric circles 


gular, square, and round, 
are used to illustrate length, 


width, and depth. 


. The scale graduations on 
each end and both sides of 
the steel rule are shown one 


at a time. 


. A hook rule is used to meas- 
ure from the shoulder of a 


metal block. 


. A slender flexible rule is 


held up for close-up shot. 


. The steel rule is shown so 
that the worn corners on 
one end are plainly visible. 

. The steel rule is wiped with 
an oiled rag several times. 


each block to empha- 
size length, width, 
and depth. 

Each scale graduation 
is spot lighted as it 
appears. 


The rule appears to 
move by itself onto 
the shoulder. 


End of rule is bent 
back and released 
which causes it to vi- 
brate. 

Extreme close-up of 
this worn end. 


flash on screen as 
length, width, and 
depth are mentioned. 
Train-crossing signals 
flash on before each 
graduation appears. 


Still shot of an athlete 
in action appears be- 
fore and after rule is 
put on shoulder. 


Portrait of pretty girl 
appears before flexible 
rule is discussed. 


The entire scene is 
tinted pink. 


Picture of oil can is | Picture of cow’s tail. 


flashed on the screen 
with the mentioning 
of oil. 


Long, short, and low 
tones emphasize 
length, width, 
depth. 

A female voice names 
each graduation as it 
appears. 


and 


Before hook rule ap- 
pears commentator 
says, ‘‘ Now hear this. 
You are to remem- 
BBY u.s 

A 2nd male voice 
gives the name of the 
rule. 


The commentary is 
read, slowly with em- 
phasis. 

A squeaking sound is 


heard as oiled rag is 
rubbed across rule. 


Auto horn sounds as 
length, width, and 
depth are mentioned. 


A train whistle sounds 
before each appear- 
ance of the gradu- 
ations. 

Commentator loudly 
clears throat before 
discussing hook rule. 


Sound of buzzing air- 
plane before flexible 
rule is described. 


Sound of applause in 
the background of en- 
tire scene. 
Fire siren starts when 
rule is rubbed with 
oiled rag. 


[4:12 


fibojoyofisq youoynonpg [o ритор ew 


ГЭ] 


7. The spring caliper is closed | Picture of hand 
Properly by squeezing the squeezing the Ist and 
legs together. 2nd fingers of other 

hand together. 

8. A group of adjustable pre-| As each is mentioned, 
cision instruments (mi- one micrometer and 
crometer and vernier са]- | опе vernier caliper 


iper) are shown on work- | turns around by itself. 
bench, 


pear as caliper legs are 
closed. 


Picture of a hammer 
hitting a nail as each 
instrument is men- 
tioned. 


9. Two parts of the microm- 
eter, the barrel and thim- 
ble, are discussed. 

10. A piece of paper is drawn | Close-up of paper 
between the micrometer's | being drawn through. 
measuring surfaces to clean 
them. 


11. Micrometer is adjusted to | Spot-light on measur- 


Finger points to the 


Shot of a smoke stack 
thimble. 


before thimble is men- 
tioned. 

Picture of turkey’s 
head appears. 


Shot of close-up of 


show that graduations ing surfaces and on 
should line up to zero when | scale graduations. 
measuring surfaces are 
closed. 
12. Micrometer is twirled to 
show “wrong way" of ob- 
teining rapid adjustment. 


two eyes looking at 
camera. 


Mierometer is twirled | Picture of man get- 
very rapidly. ting hit in the jaw. 


Concentric circles ар- | Crunching sound as 


caliper legs are closed. 


The word micrometer, 
said with a rising in- 
flexion, is followed by 
an ascending whistle. 
After the word ver- 
nier caliper is said 
with falling inflexion, 
a descending whistle 
follows. 

A 3rd male voice 
names the thimble. 


Resinous twang is 
heard as paper is 
pulled through. 


2nd male voice reads 
commentary. 


Ratchet sound while 
micrometer is twirled. 


Sound of music as 
caliper legs are closed. 


After each word is 
said, a gurgling sound- 
like pouring liquid 
from a jug is made. 


Sound of squeaking 
door before thimble is 
mentioned. 

Sound of cuckoo clock 
as paper is pulled 
through. 


Sound of sawing wood. 


Sound of miscellane- 
ous objects falling 
down and breaking. 
(Fibber MeGee's 
closet.) 


sazaq buruznb-uoyuayp fo pafa 


68? 


13. 


14. 


15. 


16. 


17. 


Basic Version 


TABLE 1.—Continued 


Attention-gaining Devices Added to Basic Version 


Visual Relevant 


Visual Irrelevant 


Sound Relevant 


Sound Irrelevant 


Micrometer approaches 


Restraining hand 


moving object in lathe as | stops the micrometer. 


if to measure it. 


A micrometer which meas- | Six-inch steel rule is 


ures from three to four 
inches is called a four-inch 
micrometer. 

The vernier caliper is used 
to measure a part in a lathe. 


Snap gage is shown in com- 
parison with a micrometer 
in background. 


The three part of the snap 
gage (anvil, go button and 
not-go button are described 
as gage is shown on work- 
bench. 


placed along side mi- 
crometer. 


Part of scene at un- 
usual angle from 
under the operator’s 
arm. 

Snap gage is moved to 
extreme close-up in 
foreground with mi- 
crometer in back- 
ground. 

Finger points to each 
part as it is men- 
tioned. 


Scene goes in and out 
of focus. 


Concentric half-circles 


appear on the screen. 


Picture of profile of 
man’ face. 


Pitcher throws ball at 
camera, 


Commentator says, 
“Now watch this 
closely.” 

Female voice reads 
commentary. 


Background sound of 
lathe running. 


8rd male voice reads 
commentary. 


Concentric half circles 
appear before each 
part is mentioned. 


Sound of anvil when 
anvil is mentioned, 
sound of “go” police 
whistle for go button, 
and "stop" whistle 
for not-go button. 


———— — — A 


Sound of jazz music. 


Sound of water splash 
and gurgling effect. 


Sound of baby crying. 


Sound of breaking 
glass. 


Sound of horse whin- 
nying as each part is 


mentioned. 


BP 


fibojowofisq youoynonpy fo ритор эці, 


18. A part is inserted in a ring] Zoom to close-up. 


1 Picture of man lying 
gage several times. 


on ground, feet near- 
est camera. 

Picture of locomotive 
centrate attention on | coming at camera. 
gage blocks. 
All ‘but one straight | Picture of baby as 
gage disappear and | each group of gages is 
reapypear. All but mentioned. 

one taper gage dis- 
appear and reappear. 


19. Snap gage is inspected for | Circular mask to con- 
accuracy with gage blocks. 


20. Straight plug gages and 
taper plug gages are shown 
on workbench. 


21. Shot of hole in metal pert. 
Hole contains many burrs. 

22. Measuring instruments аге 
being checked in inspection 
laboratory. 

23. Gage blocks are used to 
check setting of fixed gage. 


Buz-rs gradually dis-| Picture of airplane 
appeear by a dissolve. | diving through sky. 
Shest of large white | Picture of hammer 
che=ek mark. hitting nail. 


Uzsusual angles: close | Still picture of athlete 

of gage with in- | in action. 

tor's eye appear- 
im zz through curve of 
; gage із seen in 
ga Douette, 
C3*reular mask makes | Picture of gun being 
спреш appear аз | fired at camera. 


24. Two gage blocks are 
“wrung” together. 


ough a hole. 
25. Shot of projection compara- fand points to the | Picture of girl's legs. 
tor. «s omparator. 
26. Shot of the interference extreme close-up of | Picture of boy and 
bands produced by thelignt- he interference girl kissing. 
wave instrument. 


mands. 


Ascending whistle 
when part is inserted 
in gage. 

2nd male voice reads 
commentary. 


After “straight plug 
gages” said with ris- 
ing inflexion, an as- 
cending whistle. 
After “taper plug 
gages” a descending 
whistle. 

Sound of filing metal 
as burrs disappear. 
Voice says, “О. K.” 


Female commentary. 


Sound of woman’s 
scream as blocks are 
“wrung.” 

2nd male voice reads 
commentary. 

Sound of voice count- 
ing “1, 2, 3, 4, 5." 


Pistol shot when part 
is inserted in gage. 


Sound of fog horn. 


Sound of drum roll as 
each group is men- 
tioned. 


Sound of telephone as 
burrs disappear. 
Sound of hammer hit- 
ting nail. 


Sound of rooster crow- 
ing. 


Sound of coughing as 
blocks are “wrung.” 


Sound of “gibberish” 
(Donald Duck). 
Sound of kiss and 
sigh. 
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PROCEDURES 

At each testing center, the following procedures were employed: 
intact companies of recruits were divided at random into six 
comparable groups. Five of these groups were each shown one 
of the film versions (B, VR, VI, SR, or SI) and, immediately after 
the film, given the information tests and the device recall test. 
The sixth (control) group was given the information test without 
having seen the film. Test responses were recorded on IBM 
answer sheets, and machine-scored. 


STATISTICAL TREATMENT OF THE DATA 


For the men in each population both a measure of general 
intelligence and a measure of mechanical aptitude were available. 
Mean scores for the information test for the six treatments were 
calculated, and these means were adjusted, by an analysis 0 
co-variance, to take into account small differences in initial 
ability as measured by the general intelligence and mechanical 
aptitude tests. The adjusted means therefore reflect the per- 
formance to be expected of groups having equal mean gener? 
intelligence scores and equal mean mechanical aptitude scores. 

To determine the relationship between the information test 
and the device test, scores on these two tests were correlated. 


RESULTS 
Comparison of the Film Versions 
Information Test Results—In Table 2 the mean scores on the 
information test are given for the six groups of enlisted men 1n 
the Army and in the Navy. The adjusted means are given 1” 
parentheses. Table 3 summarizes the differences among the 
adjusted information test mean scores. 


The findings can be summarized for both the Army and Navy 
populations as follows: 

1) For all film groups substantial learning resulted from viewing 
the film. In each case, the film group mean score was betwee? 
one and two standard deviations higher than the mean score ? 
the comparable control group that saw no film. | 

2) The ‘sound irrelevant’ group had a lower mean score, i? 
each population, than any other film group. It is to be noted, 
however, that the visual irrelevant version was the most effective 


p 


| 


5 
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TABER 2.— 
Fen P 2.—Raw Mean Scores AND Apsustep Means or Navy 
RMY POPULATIONS ON IxFORMATION TEST AFTER VARIOUS 


Firm TREATMENTS 


c— HEN ee 


"Treatment 


Visual Relevant 
| (VR) 
Visual Irrelevant 
(VI) 
Sound Relevant 
(SR) 
Sound Irrelevant 
Basie ae 


Control (C) 


Navy 

N Mean sD 

136| 67.63 15.18 
(69.55)* 

148 | 65.45 16.07 
(66.62) 

135| 70.64 14.19 
(70.68) 

155| 66.67 15.17 
(65.11) 

331| 69.80 15.87 
(69.52) 

150| 40.57 10.40 


* Adjusted me: i 
eans are in parentheses. 


Тав 
LE 3.—Dirrerences AMONG ADJUSTED Mean Sco 


VR 

be —2.93* 

S +1.13 
E —4,44*** 

C — .03 
—29,67*** 

80 ox 

SI +.98 

B „ыл 
4.07 *** 


€ moe 
tha 


a 
pm table, the mean for the group liste 
Signis, group listed on the left. 
*si icant at the 5 per cent leve 

**x Snificant at the 1 per cent level 0 

Significant at the 0.1 per cent level 


INFORMATION TEST? 


Army 

N | Mean | SD 

248| 47.84 | 17.36 
(48.02) 

229| 49.83 17.26 
(49.24) 

226| 48.12 16.31 
(49.00) 

242| 46.35 155 
(46.31) 

367| 52.55 |18.80 
(52.09) 

264} 30.04 9.74 
(30.41) 


RES FOR 


VI SR Е Я 
Navy s 
+4.06** M Fs - 
"Y CH P eek TE 
+2.90* —1.16 +4. 
og zaree —80.80*** —25.28"** —29.64*** 
Army P 
—.24 E Js - 
12.85; 180" РЕ — 
Be 3.09** А ++ 
isi 218 вожен —15.90*** —21.08 
i listed on the toP is subtracted from 


] of confidence. 
{ confidence. 
of confidence. 
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of all the versions containing attention devices for the Army 
population. 

3) The remainder of the inter-film differences were inconsistent 
for the two populations, and generally insignificant. In the 
Army, the basic version was consistently more effective than any 
device version, while in the Navy it was about equal to the two 
relevant device versions. 

4) No significant difference was noted as between the visual 
devices and the sound devices versions, combined without respect 
to relevance of devices. For the Navy, the weighted mean of 
the two visual devices versions was 68.02, as compared with & 
weighted mean of 67.70 for the sound devices versions. For 
the Army, the visual devices group mean, without respect to 
relevance of device, was 48.60, while the sound group mean was 
47.61. (These are all adjusted means.) 


Results of the Device Recognition Test 


The recognition test items were divided into two groups fet 
each film version: (1) those devices that were in the film (Test Ci) 
and (2) those devices that were not in the film (Test C2). 

In scoring responses for the C, test, which comprised the 
devices actually in the film, a plus one (4-1) was given for each 
device reported as present, a zero (0) if the subject reported he 
did not remember, and a minus one (—1) if the device was 
reported not present. 'The reverse of the scoring of the Ci test 
was used for the С, test which comprised all devices not in the 
version being tested. A plus one (+1) was given for each device 
reported as not present, a zero (0) if the subject did not remember, 
and a minus one (—1) for each device reported as present. These 
scores were totaled for each film version and the tests (C, and 
Сз) correlated with each other as well as with the film informa- 
tion test scores. Table 4 reports these correlations 

All the correlations between the film information test and the 
C, test, and the film information test and the C» test, 816 

generally insignificant although positive indicating that there 
was only a slight relationship between scores on the film test 
and the remembering of the devices. The correlation between 
the C, and С» tests is also low. In all cases except one, whic 

was practically zero, the correlations were negative. Analysis 
of the data showed that there was a slight tendency for the 
individual to mark the 'not-present? devices as present in the 
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Тав 
LE Z-—Q 
: ORRELA Ч 
peed Viene eg BETWEEN Device RECOGNITION 
MATION 3 
ыр eo d C, Test-DEVICES IN THE VER- 
2 sr-Dzvices Nor IN THE VERSION 


C, Test and С, Test and C, Test 
а Information | Information and 
p Test Test C; Test 
Lo JE 
E Navy | Army | Navy Army | Navy | Army 
1sual Relev. 
Visual "ae ne .185 | .191 | .191 330 |—.295) —.079 
Sound Relev ant .338 | .299 | .182 .944 042| .058 
Sound ed ere .293 | .092 | .141 | .208 — 431|- 225 
х ant | 107 | ors | .078 | -150 7 010525 
.214 | .334 
* Since tl "ш" 
for this A Version contained no devices there was no C; test score 
In other 


devices as present. 


film, i 
» if h 

e marked the ‘present’ 
to indicate that devices 


Words . 
Were des re was a general tendency 
An nae: whether they were used 
the Decks, T of responses to the in 
First, sheen Recognition Test reveale 
and SI versio: only about half the items ine 
the grou Tslons were recognized by seventy Per 
evices it. eeing these versions, al 
Der cent he VI version were correc 
the вокат more of the groups seein 
знаеа devices seemed to h 
®cond, wh i a greater extent than any other type of device did. 
recognize d ereas a maximum of only seven devices were falsely 
(ie., they were not in the version but the subjects 
à Sion grou of the , VI, and 
lS props: ps, fifteen items were falsely recognize at least 
that rim tion of the sound irrelevant group- It is suggested 
50 that п sound devices tended to confuse the subjects 
ey were uncertain about what they did hear. 


RESULTS 


or not. 
dividual items included in 
d two significant points. 
luded in the VR, 8R, 
cent or more (9 
quarters of the 
tly recognized by seventy 
g this version. In short, 
ave called attention 'to 


most three 


Ver, 


The SUMMARY OF THE 
рендер; тау Ье summarized with respect to the three 
ntal hypotheses as follows: 


IR 
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Device relevancy.— There is no evidence that the insertion of 
relevant devices, as defined in this study, adds to the effective- 
ness of an informational film. There is some evidence that irrele- 
vant sound devices detract from the teaching effectiveness of 
such a film. (For both populations, the sound irrelevant ver- 
sion yielded the lowest scores.) To a lesser degree there is 
evidence that any of the devices used may have the same effect. 
(For the Army populations the basic version—no devices— 
yielded the highest score.) 

Device medium.—No significant difference was found between 


the effectiveness (or ineffectiveness) of visual and sound atten- 
tion-gaining devices. 
Device recognition.—Ability to recognize and remember which 


devices were used in a film version was practically independent 
of learning from the version. 


CONCLUSIONS AND RECOMMEN 

This study leads to the general conclusion that attention- 
gaining devices of the kinds inserted in these films do not add 
significantly to learning, 


DATIONS 


The following recommendations are Suggested as a result of 
this investigation: 


ning films should present the subject 
orward way and avoid the use of such 


à ; to gain the learners! attention. 
2) If it Seems necessary, in an instructional film, to use devices 
to attract or direct the learners’ attention, use a technique which 
will emphasize something al i 


The findings of this experi gely negative; however, 
that does not nullify the usefulness of the study. It is almost 
as important to discover that certain techniques are ineffective, 
as it is to learn that other techniques are effective. In general, 
this study corroborates the belief which many educators have 
held for a long time, that it is not necessary to have a fancy, 
expensive treatment to convey ideas by means of film 


i Le n , and that a 
simple straightforward treatment is often the most, effective, 


A COMPARISON OF READING ABILITY AND 
READABILITY 


JOHN U. MICHAELIS and FRED T. TYLER 


School of Education 
University of California, Berkeley 


Numerous attempts have been made to develop a satisfactory 
technique for determining the level of reading difficulty of 
printed materials. There are three of these which are given 
most extensive use at the present time; namely, those proposed 
by Lorge, Flesch, and Dale and Chall. Since their appearance 
many types of materials have been appraised by one or more of 
the formulae: textbooks and children's books;* advertising;! 
industrial publications; pamphlets on international relation- 
ships; newspaper materials;? corporate annual reports.?! 
The formulae have been used by the American Library Associa- 
Поп! and the United States Department of Agriculture Exten- 
sion Service.?? 

Since these techniques essentially provide a type of ‘ measur- 
ing’ instrument, they should be examined to determine their 
validity and reliability. The first study on reliability, i.e., 
‘analyst-to-analyst reliability, of the Flesch formula was reported 
by Haynes, Jenkins and Walker.? They conclude that “For 
practical purposes the Flesch formulas and the directions for 
their use are sufficiently objective to be used even by inexpe- 
rienced analysts to obtain estimates of reading ease and human 
interest of written materials.” As for validity, Flesch found 
that materials rated as more readable by his formula were also 
more readable according to readership surveys and to expert 
opinion. The studies which the present writers have located 
have relied upon this latter type of criterion of readability. 
The subjective nature of such a criterion raises the question of 
its reliability. 

PURPOSE 

For the present paper it is assumed that materials rated as 
readable at a certain grade level should be understandable to 
students at that level. Thus, if a readability formula indicates 
that certain material is located at the Grade IX level, then it 
is to be expected that children at the Grade IX reading level 
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should be able to read the material and then to answer questions 
on it with a high degree of accuracy. 

The purpose of the present paper is twofold: (a) to determine 
the readability of certain United Nations publications by each 
of the three readability formulae mentioned above; (b) to deter- 
mine the reading ability of a group of Grade XII students by 
means of some standardized reading test, and the accuracy with 
which these same students can answer questions based on the 
United Nations materials. 

The need for such a study has been emphasized in numerous 
papers appearing during the last few years. Lostutter!? con- 
cluded that the Flesch formula was best adapted for the measure- 
ment of the readability of newsprint. 
each of the three formulae has a specific function to perform. 
He claims that his formula will give “evidence on the com- 
prehension difficulty of the kind of reading pupils have to do in 
school," that the Flesch formula provides a measure of read- 
ability of magazine materials, and that the Dale-Chall formula 

will make for adequate appraisal of health materials." Flesch, 


on the other hand, has pointed out that, “There is no theoretical 
Justification for this neat pige 


those mentioned were ba: 
namely, the McCall- 


Lorge" has stated that 


materials: “The statisti 
values are insignificant. 


TEST MATERIALS 


The Iowa Silent Reading Test (Form Cm) was a diramisteredi 0 
forty-two boys and thirty-six girls in Grade XII at the Oakland 
Technical High School to determine the grade level at which 


use in high- s f 
classes. gh-school social studies 


= n a a m 


" 


» tions. 
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The U. N. test included four subtests: vocabulary, sentence 
comprehension, paragraph comprehension, and reading for 
details. The first part required the students to read a paragraph 
chosen from one of the U. N. pamphlets. The students were 
allowed three minutes to read and study the materials. At the 
end of that time the printed materials were collected and the 
students attempted to answer questions based on their reading. 
There were nine multiple-choice questions in Part I. The second 
part was a vocabulary test, again multiple-choice in nature. 
The test included twenty-two words and phrases, such as “ pre- 
amble,” “scope,” "indigenous," “the framers of the Constitu- 
sion,” and “ocean rendezvous.” The third part consisted of a 
series of sentences, a phrase in each sentence being underlined. 
The students were required to indicate which of four choices 
could most reasonably be substituted for the underlined expres- 
tion. The last part attempted to measure the students’ under- 
standing of short paragraphs. The multiple-choice questions 
were arranged to test the ability of the student to select the best 
title for the paragraph; to test his knowledge of word meanings; 
to test his ability to read for details. There was also a free 
expression question on each paragraph, but this item is not used 
in the present report. The reliability of the test of sixty-nine 
items, determined by the split-half method and stepped-up by 
the Spearman-Brown Prophecy formula, was .85. 


FINDINGS 


The readability of the U. N. materials was determined by 
each of the formula listed above. The Lorge formula considers 
average sentence length, ratio of prepositional phrases to number 
of words, and ratio of hard words to number of words in various 
samples of the materials being appraised. The Flesch formula 
for reading ease involves the determination of number of syllables 
per one hundred words and average sentence length. The 
Dale-Chall formula requires the calculation of average sentence 
length and the number of hard words. Readability by each 
formula was determined on the same sampling of U. N. publica- 
Five selections were chosen from each of five pamphlets 
irections for the application of the formulae. 
mber of words was included in each 
f readability was done on two separate 


according to the d 
Similarly the proper nu 
sample. The computation o 
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occasions with practically identical results. Furthermore, five 
other samples were chosen from each of the five pamphlets. 
Readability was determined for each of these samples, the 
results checking with those obtained from the previous sampling. 
Also the U. N. test was prepared in the main from the materials 
that had been used to determine readability. The readability 
of the test materials and of the instructions for the test was also 
determined by each formula. The U. N. publications varied 
from seven to two hundred one pages in length and were believed 


to be representative of those available for use in the public 
schools. 


TABLE I.—READABILITY or UNITED Nations MATERIALS 
APPRAISED BY THREE FORMULAE 


eS Ng 


Ratings According to Formulae 


United Nations Dale-Chall Flesch Lorge 
Material Ge d 
ade 
Raw Place. Raw | Level of | Raw o 
Score went Score | Difficulty | Score ment 
Basic Facts 9.6226 13-15 28.0720 College [8.6524] 8+ 

graduate 
Everyman's UNO 9.4727 


18-15 |24.2233| College — 8.3557 8+ 
graduate 
FAO 8.2895) 11-12 |38.9930| 13-16 7.5497 7+ 
Guide to UN Charter 9.8611| 13-15 |31 7220 13-16 8.1380] 8+ 
How Peoples Work |9.5917] 13-15 |37.6400 13-16 7.9803] 8 
Together 


Average 9.3675) 13-15 |32 


.2500| 13-16 8.1352] 8+ 


Table I shows the readability of the five pamphlets computed 
by each of the three formulae discussed above. From the table 
it may be seen that the Lorge formula indicates that the materials 
should be readable at about the Grade VIII level. According 
to the Flesch formula the materials are rated at the college under- 
graduate and graduate levels, Readability as estimated by the 
Dale-Chall method is placed at Grades XI to XV for the different 
pamphlets. There is, then, considerable discrepancy between 
the results obtained from different readability formulae. 


& 
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As has been mentioned, it has been assumed for this study 
that if materials are readable at a certain level, then students 
at that level of reading ability should be able to read the mate- 
rials with a high degree of accuracy. Specifically this would 
mean that according to the Lorge formula children who read 
at about the Grade VIII level should be able to comprehend the 
U. №. materials. Table II shows the mean percentile rank on 
the Iowa Silent Reading Test of the seventy-eight subjects in 
Grade XII according to the manual of directions. 


TABLE IL.—M AN STANDARD Scores AND PERCENTILE RANKS 
or SUBJECTS 
Mean Standard Percentile Ranks 


Subtest Scores in Grade XII 
l. Rate 171 41 
1. Comprehension 203 92 
2. Directed Reading 166 42 
3. Poetry Comprehension 172 50 
4. Word Meaning 179 56 
5. Sentence Meaning 171 35 
6. Paragraph Comprehension 176 58 
7. Use of Index Le 63 
7. Selection of Key Words 169 43 


The mean standard score on the whole test was 174, which 
corresponds to a grade equivalent of 13.0, indicating that these 
students were on the average reading at about the Grade XIII 
level. 

Before indicating the success of these subjects on the U. N. 
reading test, it is desirable to indicate the readability level of the 
test materials and of the instructions to the test. This is done 
in Table III. 

The sampling of test materials was no more difficult than was 
the sampling of the U. N. publications; the instructions were 
readable at a slightly lower level than were the test materials. 
The U. N. test was slightly easier than were the pamphlets 
upon which it had been based because the readability score for 
the test included the estimate of the readability of the instruc- 
tions. It now remains to indicate how well the students were 
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TABLE IIL—RzapaBILITY OF U. №. TEST AND or TEST 


INSTRUCTIONS 
U.N. Test Test Instructions 
Raw ; Raw Inter- 
t а 
Formula Sars Interpretation SE pictation 


Dale-Chall 8.8025 | Grades 11-12 | 6.7622 Grades 7-8 


Flesch 45.3711 | Grades 13-16 | 64.8980 Grades 8-9 | 
Lorge 7.7462 | Grades 7+ 6.3335 | Grades 6+ 
ee 


Taste IV.—MzaN Scores ON U. N. Reanna TEST 


Mean Percentage 
Subtests No. of Items 


Mean Correct 
1 9 6.44 71.56 | 
2 22 15.47 70.32 
3 6 3.79 63.17 
4 32 17.36 54.25 
Total 69 43.06 62.41 


able to perform on the U, N. reading test, 
of the subtests are shown in Table IV. 


In the absence of any absolute standard of how well students 
reading at the Grade XIII level should be able to perform on 
the U. N. reading test, it stil appears reasonable to conclude 


that even at this level of ability the test off arabe 
difficulty. It would see est offers consi 


та that students Who are reading below 
the Grade XIII level would experience even more trouble. 
Judged by this criterion of reading ability, the readability 
formulae appear to place the U. ; materials at too easy a level; 
some formulae showing a great 


49 ег disparit reading 
ability and readability than do others, Senne: lhohwsen з 


Mean scores on each 


SUMMARY AND CONCLUSIONS 

The present findings offer Support 
different formulae may be more 
than for others. If this is 80, 


to Lorge's contention that 
Suitable for some materials 
there is need for research to deter- 
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mine the most appropriate formula to use with specific types of 
materials. There seems no doubt that factors other than those 
now being considered must be employed if suitable formulae 
are to be developed. As Lorge has pointed out, present tech- 
niques really do not assess the difficulty of the concepts found 
in the materials. Length of word and number of syllables are 
not necessarily correlated with abstractness of a concept, for 
some very abstract concepts involve few letters, whereas some 
concrete concepts are expressed by lengthy words. 

The following conclusions appear to be justified by the evidence 
here presented: 


1) There is considerable disparity between the readability 


levels found for U. N. materials by different readability formulae. 

2) The Flesch and the Dale-Chall formulae estimate the read- 
ability of this type of material somewhat more accurately than 
does the Lorge formula, if level of reading ability is used as the 
criterion. 

3) The U. N. materials sampled appear to be too difficult for 
high-school students. 

Finally, it would appear that there is need for extended study 
of the readability of various types of materials intended for use 
in the publie schools. These studies might well be carried out 
on regular types of school materials as well as on special materials 
such as pamphlets at various grade levels. Further study of 
the problem of readability is indicated, probably especially 
designed to consider the nature of the concepts involved. Lastly, 
it may be that the basic formulae are logically sound, and that 
the problem is the development of more valid norms. 
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NOTES ON A SUGGESTED INDEX OF ITEM 
VALIDITY: THE U-L INDEX 


A. PEMBERTON JOHNSON 


Educational Testing Service 
Princeton, New Jersey 


In 1935 Long, Sandiford, et al,* reported an empirical com- 
parative study of the effectiveness of thirteen validity techniques 
in selecting from among four hundred eighty-two six-choice 
vocabulary items that set of fifty and that set of one hundred 
items which correlated highest with criterion scores based on all 
four hundred eighty-two items. For this situation they con- 
cluded, among other things, that those validity techniques which 
tend to discriminate in favor of items of fifty per cent difficulty 
appear to be superior to the techniques such as bi-serial r, Kelley 
and Vincent which make no discrimination in favor of median 
difficulty items. “Considering both effectiveness and ease of 
computation, they concluded that among those techniques 
tending to select items of fifty per cent difficulty (percentage 
passing), the upper vs. lower (group) technique was to be pre- 
ferred. They stated that item validities derived by the upper 
vs. lower technique tend to reach maximum reliability when the 
proportion of cases in each of these groups is twenty-seven per 
cent.[ Numerically the item validities were expressed in this 
technique by the difference between number of correct responses 
for the highest twenty-seven per cent (or by the highest third) 
and the number of correct responses for the lowest twenty-seven 
per cent (or the lowest third) of the cases as arrayed on the cri- 
terion scale. 

This paper proposes the U-L Index, a simple modification of 
the upper-lower twenty-seven per cent technique. This index 
proved extremely useful during World War II as a basis for 
selecting items to be included in Army Air Forces bombardier 
knowledge tests. The U-L Index effectively tends to select 


* John A. Long, Peter Sandiford, and Others. The Validation of Test 
Items, Bulletin No. 3, Dept. of Ed. Res., University of Toronto, Toronto, 
1935, pp. 94-5. 

+See also T. L. Kelley, “Тһе Selection of Upper and Lower Groups for the 
Validation of Test Items," J. Educ. Psychol., xxx, January, 1939, pp. 17-24, 
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items of moderate difficulty which show good separation pie 
upper and lower twenty-seven per cent groups. It is pe 
easily computed and interpreted than any conventional i в 
validity index known to the author. For many practical tes 
construction situations where expensive item analysis cannot be 
justified, it is believed to be quite useful. . 
This modification possibly has been used by other investi- 
gators before, but is believed not to have been. It requires the 
difference between the groups in number of correct responses to 
be divided by the number of cases in each group. Symbolically, 


if 
Е, = number correct Tesponses in the upper group of 
twenty-seven per cent 
Ri = number correct Tesponses in the lower group of 
twenty-seven per cent 
N = number of cases 
f = .27N 
-MSk R= Ri 
U-L Index — MN = (1) 


This index can theoretically vary from 4-1 through 0 to — 1. 
These proportions are independent of the N of the population 
sample and similar in magnitude though not strictly in meaning 
to conventional correlation Coefficients, 

Long, Sandiford, et al., found in their empirical study that (1) 
the average difficulty of а, &roup of items shown to be least valid 
by the bi-serial 7 technique was about equal to the average 
difficulty of the group of items indicated to be least valid by the 
upper-lower thirds technique, but (2) that the bi-serial r tended 


to eliminate items indiscriminately throughout the entire range 
of item difficulty where 


| hereas {һе Upper-lower thirds technique 
tended to eliminate items farthest Temoved from the fifty per 


* Ibid., p. 114. 
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U-L Index in somewhat different fashion than the conventional 
bi-serial r. 

The standard error of the U-L Index may be derived from the 
conventional formula for the standard error of the difference of 
two proportions, when the data are uncorrelated. 


Guilford* gives the following generalized formulae: № 
#34 бар = Vo? + ор — 2700р, 


#28 ср = da 


where: og, = S.E. of a difference between two proportions 


c, = S.E. of a proportion 
pı = 1st proportion 

p» = 2nd proportion 
q=1-p 

N = number of cases 
r= 


coefficient of intercorrelation of the two sets of 
data. и 
Using the previously mentioned symbols for the U-L Index: 


«p - DEAF) s pars 
l dno ee 


E. ai. 


Similarly t= 


1 R? 
E DR — 
IN 3 
In Guilford's formula #34 for cap, the most conservative esti- 
mate of т іѕ 0. That formula then reduces to ca» = ус F ope? 
By substitution: 
1 Ri? Rè 
SE U-L Index = z4|R, — —- + R; — — 
j ЕЛЕС. 


1 
cR m- (ER) 


The formula for the standard error of the U-L Index is such 
that the maximum value of the standard error occurs in the 


*J. P. Guilford. Fundamental Statistics in Psychology and Education, 
New York: McGraw-Hill, 1942, pp. 133 and 142. 
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TABLE 1—5% AND 1% "t" TEST SIGNIFICANCE LEVELS FOR 
THE SE or U-L INDEX WHEN THE U-L INDEX = 0 AND 50% 
Pass THE Ітем* 


N f=.27N SE of the U-LIndex 5% Level 1% Level 


100 27 .136 ‚2718 ‚364 
148 40 .112 .228 .295 
200 54 -096 .190 .252 
248 67 .087 .172 .227 
300 81 .079 .156 .206 
348 94 .073 .144 .190 
400 108 .068 .184 .177 
500 135 -061 .120 ‚159 
1000 270 ‚043 ‚084 lll 


fifty per cent passing situation where the tr 
Table I below gives the 5% 


the SE of the U-L Index in t 

À quite serviceable index o 
for each item can be obtain 
use of the following formul 


ue index equals zero. 

and 1% “t” significance levels of 
hat situation. 
f item difficulty (percentage passing? 
ed from the values for R, and It; by 
а: 
Difficulty level (percentage passing) = 100 E + R) 

» х, т R) (3) 


Since this is based on о 
the cases, it does not give 
difficulty which would b, i 


items is appreciable. 


Omissions on speeded tests are usually of two types: (a) those 
by persons who read the item but fail to mark any choice and 
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(b) those by persons who have not read as far in the test as the 
end of that item. Davis* in a communication to the writer 
suggests a method of determining the ‘non-reads’ directly. The 
test papers are scored and arranged in rank order according to 
the criterion score. The group which includes the top twenty- 
seven per cent of papers is segregated as is the group which com- 
prises the bottom twenty-seven per cent of test papers. Next 
the papers of the upper group are gone through to determine 
which item on each paper is the last one marked. A tally is 
then made opposite the number of the next item for that one is 
presumably the first item not read by the subject. This tally 
is the basis for a cumulative frequency table of the number of 
cases within the upper group who have not read each particular 
item. A similar count is made of the ‘non-reads’ in the lower 
group or the bottom twenty-seven per cent of the test papers. 

By graphic item count on the International Test Scoring 
machine, or by other means, the number of right responses and 
the number of wrong responses in the upper group to each item 
is found. The omits may be obtained, if desired, by subtracting 
from the number of papers within the upper group the rights 
plus wrongs plus ‘non-reads.’ Similarly the omits among the 
lower group may be obtained, if desired. 

Where the ‘non-reads’ represent an appreciable proportion of 


either criterion group the following formula for the U-L Index 
18 suggested: 


Ru Sa Ri (4) 
(f — 'nonceads')) (f — *non-reads';) 


where №, = number of right responses in the upper group 
Ri = number of right responses in the lower group 
| f = .27N 
‚ Don-reads', = ‘non-reads’ in the upper group 
non-reads’; = ‘non-reads’ in the lower group - 
Ru 

(f = ‘non-reads’,) 
responses in the upper group to the number in that group who 
M a 


* Dr. Frederick B. Davis, formerly with the Coóperative Test Service 
and the Aviation Psychology Program of the Army Air Forces, now at Hun- 
ter College. 


ll 


The Proportion is the proportion of right 
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: ; Ri 
read the item. The proportion U = *non-reads?;) 
similarly interpreted for the lower group. 

The U-L Index is proposed as a useful means of selecting items 
either to increase the internal consistency (odd-even reliability) 
of a test or to increase its correlation with a given criterion. 
Some advantages of the U-L Index are: (1) the demonstrated 
effectiveness of the upper vs. lower twenty-seven per cent 
technique on which it is based, (2) its ease of c 


i omputation, and 
(8) the readiness with which its level of significance may be 
approximated. 


may be 


